Nov 05 03:35:23 devstack cinder-volume[76028]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 03:35:23 devstack cinder-volume[76028]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 03:35:23 devstack cinder-volume[76028]: we strongly recommend against using it for new projects. Nov 05 03:35:23 devstack cinder-volume[76028]: If you are already using Eventlet, we recommend migrating to a different Nov 05 03:35:23 devstack cinder-volume[76028]: framework. For more detail see Nov 05 03:35:23 devstack cinder-volume[76028]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 03:35:23 devstack cinder-volume[76028]: import eventlet # noqa Nov 05 03:35:26 devstack cinder-volume[76028]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76028) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 03:35:26 devstack cinder-volume[76028]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76028) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 03:35:26 devstack cinder-volume[76028]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76028) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 03:35:27 devstack cinder-volume[76028]: INFO dbcounter [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Registered counter for database cinder Nov 05 03:35:27 devstack cinder-volume[76028]: DEBUG oslo_db.sqlalchemy.engines [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76028) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:35:27 devstack cinder-volume[76028]: DEBUG dbcounter [-] [76028] Writer thread running {{(pid=76028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 03:35:27 devstack cinder-volume[76028]: INFO cinder.rpc [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 03:35:27 devstack cinder-volume[76028]: INFO cinder.rpc [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_db.sqlalchemy.engines [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76028) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:35:28 devstack cinder-volume[76028]: INFO cinder.volume.manager [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Determined volume DB was empty at startup. Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG cinder.volume.manager [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76028) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} Nov 05 03:35:28 devstack cinder-volume[76028]: INFO cinder.volume.manager [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 03:35:28 devstack cinder-volume[76028]: WARNING stevedore.named [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 03:35:28 devstack cinder-volume[76028]: WARNING castellan.key_manager [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 03:35:28 devstack cinder-volume[76028]: WARNING cinder.keymgr.conf_key_mgr [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG cinder.volume.drivers.lvm [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76028) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_concurrency.processutils [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_concurrency.processutils [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] CMD "cinder-rtstool verify" returned: 0 in 0.427s {{(pid=76028) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_db.sqlalchemy.engines [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76028) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:35:28 devstack cinder-volume[76028]: INFO cinder.rpc [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 05 03:35:28 devstack cinder-volume[76028]: INFO cinder.rpc [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Automatically selected cinder-volume RPC version 3.21 as minimum service version. Nov 05 03:35:28 devstack cinder-volume[76028]: WARNING stevedore.named [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 03:35:28 devstack cinder-volume[76028]: WARNING castellan.key_manager [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 03:35:28 devstack cinder-volume[76028]: INFO cinder.volume.manager [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_db.sqlalchemy.engines [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76028) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:35:28 devstack cinder-volume[76028]: INFO oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Starting 1 workers Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Started child 76189 {{(pid=76028) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Full set of CONF: {{(pid=76028) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] ******************************************************************************** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Configuration options gathered from: {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] ================================================================================ {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] allow_availability_zone_fallback = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] allow_compression_on_image_upload = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] allowed_direct_url_schemes = [] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] api_rate_limit = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] auth_strategy = keystone {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] az_cache_duration = 3600 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_availability_zone = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_host = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_name = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_stats_polling_interval = 60 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76189]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backup_api_class = cinder.backup.api.API {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backup_name_template = backup-%s {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backup_use_same_host = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backup_use_temp_snapshot = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] changed_blocks_max_limit = 1000 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] changed_blocks_rpc_timeout = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] chap_password = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] chap_username = {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cinder_internal_tenant_project_id = 22de91c65d2944b3b37d36b2bfa441f1 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cinder_internal_tenant_user_id = 8935cc11956e4230a7bd271b34b68146 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cloned_volume_same_az = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cluster = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] compression_format = gzip {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] compute_api_class = cinder.compute.nova.API {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] config_dir = [] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] config_source = [] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] control_exchange = openstack {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] debug = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] default_availability_zone = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] default_group_type = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] default_volume_type = lvmdriver-1 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] disk_geometry = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] driver_client_cert = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] driver_client_cert_key = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] driver_data_namespace = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] driver_ssl_cert_path = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] driver_ssl_cert_verify = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] driver_use_ssl = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] enable_force_upload = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] enable_new_services = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] enable_unsupported_driver = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] enabled_backends = ['lvmdriver-1'] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] enforce_multipath_for_image_xfer = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] filter_function = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance_api_insecure = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance_api_servers = ['http://192.168.122.102/image'] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance_api_ssl_compression = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance_ca_certificates_file = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance_catalog_info = image:glance:publicURL {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance_certfile = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance_keyfile = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance_num_retries = 3 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance_request_timeout = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] goodness_function = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] graceful_shutdown_timeout = 5 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] group_api_class = cinder.group.api.API {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] host = devstack {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] image_compress_on_upload = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] image_conversion_address_space_limit = 1 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] image_conversion_cpu_limit = 60 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] image_conversion_disable = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] image_upload_use_cinder_backend = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] image_upload_use_internal_tenant = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] image_volume_cache_enabled = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] image_volume_cache_max_count = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] image_volume_cache_max_size_gb = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] init_host_max_objects_retrieval = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] instance_format = [instance: %(uuid)s] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] iscsi_target_flags = {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] iscsi_write_cache = on {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] iser_helper = tgtadm {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] iser_ip_address = 192.168.122.102 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] iser_port = 3260 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] log_color = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] log_config_append = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] log_dir = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] log_file = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] log_options = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] log_rotate_interval = 1 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] log_rotate_interval_type = days {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] log_rotation_type = none {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] max_age = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] max_logfile_count = 30 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] max_logfile_size_mb = 200 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] max_over_subscription_ratio = 20.0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] message_reap_interval = 86400 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] message_ttl = 2592000 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] migration_create_volume_timeout_secs = 300 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] monkey_patch = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] monkey_patch_modules = [] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] my_ip = 192.168.122.102 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] no_snapshot_gb_quota = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] num_iser_scan_tries = 3 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] num_shell_tries = 3 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] num_volume_device_scan_tries = 3 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] nvmeof_conn_info_version = 1 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] nvmet_ns_id = 10 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] nvmet_port_id = 1 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] osapi_max_limit = 1000 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] osapi_volume_ext_list = [] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] osapi_volume_listen = 0.0.0.0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] osapi_volume_listen_port = 8776 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] osapi_volume_use_ssl = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] osapi_volume_workers = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] per_volume_size_limit = -1 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] periodic_fuzzy_delay = 60 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] periodic_interval = 60 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] project_id_regex = [0-9a-f\-]+ {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] public_endpoint = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] publish_errors = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] quota_backup_gigabytes = 1000 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] quota_backups = 10 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] quota_gigabytes = 1000 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] quota_groups = 10 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] quota_snapshots = 10 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] quota_volumes = 10 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] rate_limit_burst = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] rate_limit_except_level = CRITICAL {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] rate_limit_interval = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] reinit_driver_count = 3 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] replication_device = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] report_discard_supported = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] report_interval = 120 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] reservation_clean_interval = 86400 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] reservation_expire = 86400 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] reserved_image_namespaces = [] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] reserved_percentage = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] rpc_response_timeout = 120 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] run_external_periodic_tasks = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] scst_target_driver = iscsi {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] scst_target_iqn_name = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] service_down_time = 720 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] shell_completion = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] snapshot_name_template = snapshot-%s {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] snapshot_same_host = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] split_loggers = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] state_path = /opt/stack/data/cinder {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] storage_availability_zone = nova {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] storage_protocol = iSCSI {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] syslog_log_facility = LOG_USER {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] target_helper = lioadm {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] target_ip_address = 192.168.122.102 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] target_port = 3260 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] target_protocol = iscsi {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] target_secondary_ip_addresses = [] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] trace_flags = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] transfer_api_class = cinder.transfer.api.API {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] transport_url = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] until_refresh = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] use_chap_auth = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76189]: INFO cinder.volume.manager [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] use_default_quota_class = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] use_journal = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] use_json = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] use_multipath_for_image_xfer = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] use_stderr = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] use_syslog = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] verify_glance_signatures = enabled {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] volume_api_class = cinder.volume.api.API {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] volume_backend_name = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] volume_clear = zero {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] volume_clear_ionice = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] volume_clear_size = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] volume_copy_bps_limit = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] volume_dd_blocksize = 1M {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] volume_name_template = volume-%s {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] volume_service_inithost_offload = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] volume_usage_audit_period = month {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] zoning_mode = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_concurrency.disable_process_locking = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.auth_section = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.auth_type = password {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.auth_version = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.cache = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.certfile = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.delay_auth_decision = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.http_connect_timeout = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.include_service_catalog = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.insecure = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.interface = public {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.keyfile = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.memcache_password = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.memcache_username = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.region_name = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.service_token_roles_required = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.service_type = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.token_cache_time = 300 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.102/identity {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.backend = dogpile.cache.null {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.backend_argument = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.backend_expiration_time = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.config_prefix = cache.oslo {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.debug_cache_backend = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.enable_retry_client = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.enable_socket_keepalive = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.enabled = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.expiration_time = 600 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.hashclient_retry_attempts = 2 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.memcache_dead_retry = 300 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.memcache_pool_maxsize = 10 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.memcache_sasl_enabled = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.password = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.proxies = [] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.redis_db = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.redis_sentinel_service_name = mymaster {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.redis_server = localhost:6379 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.retry_attempts = 2 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.retry_delay = 0.0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.socket_keepalive_count = 1 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.socket_keepalive_idle = 1 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.socket_keepalive_interval = 1 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.socket_timeout = 1.0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.tls_allowed_ciphers = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.tls_cafile = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.tls_certfile = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.tls_enabled = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.tls_keyfile = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cache.username = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] coordination.backend_url = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.asyncio_connection = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.asyncio_slave_connection = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.backend = sqlalchemy {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.connection = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.connection_debug = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.connection_parameters = {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.connection_recycle_time = 3600 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.connection_trace = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.db_inc_retry_interval = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.db_max_retries = 20 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.db_max_retry_interval = 10 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.db_retry_interval = 1 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.max_overflow = 50 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.max_pool_size = 5 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.max_retries = 10 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.mysql_wsrep_sync_wait = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.pool_timeout = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.retry_interval = 10 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.slave_connection = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.sqlite_synchronous = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.synchronous_reader = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] database.use_db_reconnect = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_tracing.insecure = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] profiler.connection_string = messaging:// {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] profiler.enabled = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] profiler.es_doc_type = notification {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] profiler.es_scroll_size = 10000 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] profiler.es_scroll_time = 2m {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] profiler.filter_error_trace = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] profiler.hmac_keys = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] profiler.sentinel_service_name = mymaster {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] profiler.socket_timeout = 0.1 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] profiler.trace_requests = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] profiler.trace_sqlalchemy = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] profiler_jaeger.process_tags = {} {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] profiler_jaeger.service_name_prefix = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] profiler_otlp.service_name_prefix = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_policy.enforce_new_defaults = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_policy.policy_default_rule = default {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_policy.policy_file = policy.yaml {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_policy.remote_timeout = 60.0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] privsep_osbrick.group = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] privsep_osbrick.helper_command = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] privsep_osbrick.user = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cinder_sys_admin.group = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cinder_sys_admin.helper_command = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] cinder_sys_admin.user = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] service_user.auth_section = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] service_user.auth_type = password {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] service_user.cafile = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] service_user.certfile = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] service_user.collect_timing = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] service_user.insecure = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] service_user.keyfile = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] service_user.send_service_user_token = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] service_user.split_loggers = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] service_user.timeout = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] service_user.tls_ciphers = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] service_user.tls_min_version = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance.auth_section = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance.auth_type = password {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance.certfile = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance.collect_timing = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance.insecure = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance.keyfile = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance.region_name = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance.split_loggers = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance.timeout = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance.tls_ciphers = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] glance.tls_min_version = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.backend_availability_zone = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.chap_password = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.chap_username = {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.disk_geometry = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.driver_client_cert = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.driver_client_cert_key = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.driver_data_namespace = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.driver_use_ssl = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.enable_unsupported_driver = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.extra_capabilities = {} {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.filter_function = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.goodness_function = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.iscsi_target_flags = {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.iscsi_write_cache = on {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.iser_helper = tgtadm {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.iser_ip_address = 192.168.122.102 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.iser_port = 3260 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.lvm_mirrors = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.lvm_share_target = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.lvm_type = auto {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.num_shell_tries = 3 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.nvmet_port_id = 1 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.replication_device = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.report_discard_supported = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.reserved_percentage = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.scst_target_driver = iscsi {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.scst_target_iqn_name = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.storage_protocol = iSCSI {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.target_helper = tgtadm {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.target_ip_address = 192.168.122.102 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.target_port = 3260 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.target_protocol = iscsi {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.trace_flags = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.unique_fqdn_network = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.use_chap_auth = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.volume_backend_name = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.volume_clear = zero {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.volume_clear_ionice = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.volume_clear_size = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.volume_group = cinder-volumes {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_reports.file_event_handler = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_reports.log_dir = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.backend_availability_zone = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.backend_host = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.chap_password = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.chap_username = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.chiscsi_conf = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.disk_geometry = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.driver_client_cert = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.driver_data_namespace = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.driver_use_ssl = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack sudo[76193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.extra_capabilities = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.filter_function = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.goodness_function = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack sudo[76193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.iser_helper = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.iser_ip_address = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.iser_port = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.iser_target_prefix = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.lvm_conf_file = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.lvm_mirrors = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.lvm_share_target = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.lvm_type = auto {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.num_shell_tries = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.nvmet_port_id = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.replication_device = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.report_discard_supported = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.reserved_percentage = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.scst_target_driver = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.storage_protocol = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.target_helper = lioadm {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.target_ip_address = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.target_port = 3260 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.target_protocol = iscsi {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.trace_flags = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.use_chap_auth = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.volume_clear = zero {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.volume_clear_size = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] lvmdriver-1.volumes_dir = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:28 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.ssl = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.ssl_version = {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_notifications.driver = [] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_notifications.retry = -1 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] oslo_messaging_notifications.transport_url = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] key_manager.fixed_key = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican.barbican_api_version = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican.barbican_endpoint = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican.barbican_endpoint_type = public {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican.barbican_region_name = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican.cafile = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican.certfile = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican.collect_timing = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican.insecure = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican.keyfile = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican.number_of_retries = 60 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican.retry_delay = 1 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican.send_service_user_token = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican.split_loggers = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican.timeout = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican.tls_ciphers = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican.tls_min_version = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican.verify_ssl = True {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican.verify_ssl_path = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican_service_user.auth_section = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican_service_user.auth_type = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican_service_user.cafile = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican_service_user.certfile = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican_service_user.collect_timing = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican_service_user.insecure = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican_service_user.keyfile = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican_service_user.split_loggers = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican_service_user.timeout = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican_service_user.tls_ciphers = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] barbican_service_user.tls_min_version = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] vault.approle_role_id = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] vault.approle_secret_id = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] vault.auth_method = approle {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] vault.auth_path = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] vault.kv_mountpoint = secret {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] vault.kv_path = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] vault.kv_version = 2 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] vault.namespace = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] vault.root_token_id = **** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] vault.ssl_ca_crt_file = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] vault.timeout = 60.0 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] vault.token_file = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] vault.token_role = None {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] vault.use_ssl = False {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:35:29 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] ******************************************************************************** {{(pid=76028) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 03:35:29 devstack sudo[76193]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:29 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.361s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:29 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:29 devstack sudo[76196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:35:29 devstack sudo[76196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:29 devstack sudo[76196]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:29 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.326s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:29 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:35:29 devstack cinder-volume[76189]: INFO cinder.brick.local_dev.lvm [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 05 03:35:29 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:29 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:29 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:29 devstack sudo[76265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 03:35:29 devstack sudo[76265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:30 devstack sudo[76265]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.385s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:30 devstack cinder-volume[76189]: DEBUG cinder.brick.local_dev.lvm [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76189) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 05 03:35:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:30 devstack sudo[76387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:35:30 devstack sudo[76387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:30 devstack sudo[76387]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.513s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:30 devstack sudo[76578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:35:30 devstack sudo[76578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:30 devstack sudo[76578]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:30 devstack sudo[76663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 05 03:35:30 devstack sudo[76663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:31 devstack sudo[76663]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:31 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.282s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:31 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:31 devstack sudo[76733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 03:35:31 devstack sudo[76733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:31 devstack sudo[76733]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:31 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.349s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:31 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:31 devstack sudo[76812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 03:35:31 devstack sudo[76812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:31 devstack sudo[76812]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:31 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:31 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:31 devstack sudo[76821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:35:31 devstack sudo[76821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:32 devstack sudo[76821]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:32 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.332s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:32 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:32 devstack sudo[76900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:35:32 devstack sudo[76900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:32 devstack sudo[76900]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:32 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:32 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:32 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:32 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:32 devstack sudo[76910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:35:32 devstack sudo[76910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:32 devstack sudo[76910]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:32 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:32 devstack cinder-volume[76189]: INFO cinder.volume.drivers.lvm [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 05 03:35:32 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:32 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:32 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:32 devstack sudo[76994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:35:32 devstack sudo[76994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:32 devstack sudo[76994]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:32 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:32 devstack cinder-volume[76189]: DEBUG cinder.volume.drivers.lvm [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Updating volume stats {{(pid=76189) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 03:35:32 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:32 devstack sudo[76997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 03:35:32 devstack sudo[76997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:33 devstack sudo[76997]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:33 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:33 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:33 devstack sudo[77000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:35:33 devstack sudo[77000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:33 devstack sudo[77000]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:33 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:33 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:33 devstack sudo[77003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:35:33 devstack sudo[77003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:33 devstack sudo[77003]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:33 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:33 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:33 devstack sudo[77012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:35:33 devstack sudo[77012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:34 devstack sudo[77012]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:34 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:34 devstack cinder-volume[76189]: INFO cinder.volume.driver [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Driver hasn't implemented _init_vendor_properties() Nov 05 03:35:34 devstack cinder-volume[76189]: DEBUG cinder.volume.driver [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76189) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 03:35:34 devstack cinder-volume[76189]: DEBUG oslo_db.sqlalchemy.engines [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76189) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:35:34 devstack cinder-volume[76189]: DEBUG dbcounter [-] [76189] Writer thread running {{(pid=76189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 03:35:34 devstack cinder-volume[76189]: DEBUG cinder.db.api [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Building query based on filter {{(pid=76189) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3952}} Nov 05 03:35:34 devstack cinder-volume[76189]: DEBUG cinder.image.image_utils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76189) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Nov 05 03:35:34 devstack cinder-volume[76189]: INFO cinder.keymgr.migration [None req-8debd17a-cb89-4e2a-9745-7c5a50166d53 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 03:35:34 devstack cinder-volume[76189]: DEBUG cinder.volume.drivers.lvm [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Updating volume stats {{(pid=76189) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 03:35:34 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:34 devstack sudo[77016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 03:35:34 devstack sudo[77016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:34 devstack sudo[77016]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:34 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:34 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:34 devstack sudo[77019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:35:34 devstack sudo[77019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:34 devstack sudo[77019]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:34 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:34 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:34 devstack sudo[77022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:35:34 devstack sudo[77022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:34 devstack sudo[77022]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:34 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:34 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:34 devstack sudo[77027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:35:34 devstack sudo[77027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:35 devstack sudo[77027]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:35 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:35 devstack cinder-volume[76189]: DEBUG cinder.manager [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Notifying Schedulers of capabilities ... {{(pid=76189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:35:35 devstack cinder-volume[76189]: INFO cinder.volume.manager [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Driver initialization completed successfully. Nov 05 03:35:35 devstack cinder-volume[76189]: INFO cinder.manager [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Initiating service 2 cleanup Nov 05 03:35:35 devstack cinder-volume[76189]: INFO cinder.manager [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Service 2 cleanup completed. Nov 05 03:35:35 devstack cinder-volume[76189]: DEBUG cinder.service [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Creating RPC server for service cinder-volume {{(pid=76189) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 03:35:35 devstack cinder-volume[76189]: DEBUG cinder.service [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76189) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 03:35:35 devstack cinder-volume[76189]: INFO cinder.volume.manager [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 05 03:35:35 devstack cinder-volume[76189]: DEBUG cinder.volume.drivers.lvm [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Updating volume stats {{(pid=76189) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 03:35:35 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:35 devstack sudo[77031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 03:35:35 devstack sudo[77031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:35 devstack sudo[77031]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:35 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:35 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:35 devstack sudo[77036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:35:35 devstack sudo[77036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:35 devstack sudo[77036]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:35 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:35 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:35 devstack sudo[77039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:35:35 devstack sudo[77039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:36 devstack sudo[77039]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:36 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:36 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:35:36 devstack sudo[77042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:35:36 devstack sudo[77042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:35:36 devstack sudo[77042]: pam_unix(sudo:session): session closed for user root Nov 05 03:35:36 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:35:36 devstack cinder-volume[76189]: INFO cinder.volume.manager [None req-41699061-00a4-486c-a768-ef7591f6fa0f None None] Driver post RPC initialization completed successfully. Nov 05 03:35:38 devstack cinder-volume[76028]: DEBUG dbcounter [-] [76028] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76028) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:35:46 devstack cinder-volume[76189]: DEBUG dbcounter [-] [76189] Writing DB stats cinder:SELECT=3 {{(pid=76189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:35:46 devstack cinder-volume[76189]: DEBUG dbcounter [-] [76189] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:36:29 devstack cinder-volume[76189]: DEBUG oslo_service.periodic_task [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:36:29 devstack cinder-volume[76189]: DEBUG cinder.volume.drivers.lvm [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Updating volume stats {{(pid=76189) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 03:36:29 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:36:29 devstack sudo[78940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 03:36:29 devstack sudo[78940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:36:29 devstack sudo[78940]: pam_unix(sudo:session): session closed for user root Nov 05 03:36:29 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:36:29 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:36:29 devstack sudo[78954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:36:29 devstack sudo[78954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:36:29 devstack sudo[78954]: pam_unix(sudo:session): session closed for user root Nov 05 03:36:29 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.241s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:36:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:36:30 devstack sudo[78964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:36:30 devstack sudo[78964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:36:30 devstack sudo[78964]: pam_unix(sudo:session): session closed for user root Nov 05 03:36:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:36:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:36:30 devstack sudo[78967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:36:30 devstack sudo[78967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:36:30 devstack sudo[78967]: pam_unix(sudo:session): session closed for user root Nov 05 03:36:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:36:30 devstack cinder-volume[76189]: DEBUG cinder.manager [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Notifying Schedulers of capabilities ... {{(pid=76189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:36:30 devstack cinder-volume[76189]: DEBUG oslo_service.periodic_task [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Running periodic task VolumeManager._thread_info {{(pid=76189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:36:30 devstack cinder-volume[76189]: DEBUG cinder.volume.manager [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] thread count: 6 {{(pid=76189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:36:30 devstack cinder-volume[76189]: DEBUG cinder.volume.manager [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] thread info: [<_MainThread(MainThread, started 129566839820416)>, , , , , ] {{(pid=76189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:37:29 devstack cinder-volume[76189]: DEBUG oslo_service.periodic_task [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:37:29 devstack cinder-volume[76189]: DEBUG cinder.volume.drivers.lvm [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Updating volume stats {{(pid=76189) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 03:37:29 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:37:29 devstack sudo[82314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 03:37:29 devstack sudo[82314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:37:29 devstack sudo[82314]: pam_unix(sudo:session): session closed for user root Nov 05 03:37:29 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:37:29 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:37:29 devstack sudo[82319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:37:29 devstack sudo[82319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:37:30 devstack sudo[82319]: pam_unix(sudo:session): session closed for user root Nov 05 03:37:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:37:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:37:30 devstack sudo[82322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:37:30 devstack sudo[82322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:37:30 devstack sudo[82322]: pam_unix(sudo:session): session closed for user root Nov 05 03:37:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:37:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:37:30 devstack sudo[82341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:37:30 devstack sudo[82341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:37:30 devstack sudo[82341]: pam_unix(sudo:session): session closed for user root Nov 05 03:37:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:37:30 devstack cinder-volume[76189]: DEBUG cinder.manager [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Notifying Schedulers of capabilities ... {{(pid=76189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:37:30 devstack cinder-volume[76189]: DEBUG oslo_service.periodic_task [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Running periodic task VolumeManager._thread_info {{(pid=76189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:37:30 devstack cinder-volume[76189]: DEBUG cinder.volume.manager [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] thread count: 6 {{(pid=76189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:37:30 devstack cinder-volume[76189]: DEBUG cinder.volume.manager [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] thread info: [<_MainThread(MainThread, started 129566839820416)>, , , , , ] {{(pid=76189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:37:46 devstack cinder-volume[76189]: DEBUG dbcounter [-] [76189] Writing DB stats cinder:SELECT=1 {{(pid=76189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:37:46 devstack cinder-volume[76189]: DEBUG dbcounter [-] [76189] Writing DB stats cinder:UPDATE=1 {{(pid=76189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:39:29 devstack cinder-volume[76189]: DEBUG oslo_service.periodic_task [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:39:29 devstack cinder-volume[76189]: DEBUG cinder.volume.drivers.lvm [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Updating volume stats {{(pid=76189) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 03:39:29 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:39:29 devstack sudo[85613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 03:39:29 devstack sudo[85613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:39:29 devstack sudo[85613]: pam_unix(sudo:session): session closed for user root Nov 05 03:39:29 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:39:29 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:39:29 devstack sudo[85616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:39:29 devstack sudo[85616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:39:30 devstack sudo[85616]: pam_unix(sudo:session): session closed for user root Nov 05 03:39:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:39:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:39:30 devstack sudo[85621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 03:39:30 devstack sudo[85621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:39:30 devstack sudo[85621]: pam_unix(sudo:session): session closed for user root Nov 05 03:39:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:39:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:39:30 devstack sudo[85625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 03:39:30 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:39:30 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root Nov 05 03:39:30 devstack cinder-volume[76189]: DEBUG oslo_concurrency.processutils [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76189) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:39:30 devstack cinder-volume[76189]: DEBUG cinder.manager [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Notifying Schedulers of capabilities ... {{(pid=76189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:39:30 devstack cinder-volume[76189]: DEBUG oslo_service.periodic_task [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] Running periodic task VolumeManager._thread_info {{(pid=76189) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:39:30 devstack cinder-volume[76189]: DEBUG cinder.volume.manager [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] thread count: 6 {{(pid=76189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:39:30 devstack cinder-volume[76189]: DEBUG cinder.volume.manager [None req-c18f605e-ba22-44d0-bf79-6e9f5c12b748 None None] thread info: [<_MainThread(MainThread, started 129566839820416)>, , , , , ] {{(pid=76189) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:39:46 devstack cinder-volume[76189]: DEBUG dbcounter [-] [76189] Writing DB stats cinder:SELECT=1 {{(pid=76189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:39:46 devstack cinder-volume[76189]: DEBUG dbcounter [-] [76189] Writing DB stats cinder:UPDATE=1 {{(pid=76189) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:39:56 devstack cinder-volume[76028]: INFO oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Caught SIGTERM, stopping children Nov 05 03:39:56 devstack cinder-volume[76028]: DEBUG oslo_concurrency.lockutils [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Acquiring lock "singleton_lock" {{(pid=76028) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 03:39:56 devstack cinder-volume[76028]: DEBUG oslo_concurrency.lockutils [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Acquired lock "singleton_lock" {{(pid=76028) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 03:39:56 devstack cinder-volume[76028]: DEBUG oslo_concurrency.lockutils [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Releasing lock "singleton_lock" {{(pid=76028) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 03:39:56 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Stop services. {{(pid=76028) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 03:39:56 devstack cinder-volume[76028]: DEBUG oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Killing children. {{(pid=76028) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 03:39:56 devstack cinder-volume[76028]: INFO oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Waiting on 1 children to exit Nov 05 03:40:00 devstack cinder-volume[76189]: DEBUG oslo_concurrency.lockutils [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Acquiring lock "singleton_lock" {{(pid=76189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 03:40:00 devstack cinder-volume[76189]: DEBUG oslo_concurrency.lockutils [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Acquired lock "singleton_lock" {{(pid=76189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 03:40:00 devstack cinder-volume[76189]: DEBUG oslo_concurrency.lockutils [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Releasing lock "singleton_lock" {{(pid=76189) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 03:40:00 devstack cinder-volume[76189]: WARNING amqp [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 03:40:00 devstack cinder-volume[76189]: WARNING amqp [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 03:40:00 devstack cinder-volume[76028]: INFO oslo_service.backend._eventlet.service [None req-6f178538-ceed-47d9-8eb6-b16e7e369a9e None None] Child 76189 exited with status 0 Nov 05 03:40:00 devstack cinder-volume[86267]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 03:40:00 devstack cinder-volume[86267]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 03:40:00 devstack cinder-volume[86267]: we strongly recommend against using it for new projects. Nov 05 03:40:00 devstack cinder-volume[86267]: If you are already using Eventlet, we recommend migrating to a different Nov 05 03:40:00 devstack cinder-volume[86267]: framework. For more detail see Nov 05 03:40:00 devstack cinder-volume[86267]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 03:40:00 devstack cinder-volume[86267]: import eventlet # noqa Nov 05 03:40:02 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86267) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 03:40:02 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86267) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 03:40:02 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86267) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 03:40:03 devstack cinder-volume[86267]: INFO dbcounter [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Registered counter for database cinder Nov 05 03:40:03 devstack cinder-volume[86267]: DEBUG oslo_db.sqlalchemy.engines [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86267) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:40:03 devstack cinder-volume[86267]: DEBUG dbcounter [-] [86267] Writer thread running {{(pid=86267) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 03:40:03 devstack cinder-volume[86267]: INFO cinder.rpc [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 03:40:03 devstack cinder-volume[86267]: INFO cinder.rpc [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 03:40:03 devstack cinder-volume[86267]: DEBUG oslo_db.sqlalchemy.engines [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86267) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:40:04 devstack cinder-volume[86267]: INFO cinder.volume.manager [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Determined volume DB was empty at startup. Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG cinder.volume.manager [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86267) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} Nov 05 03:40:04 devstack cinder-volume[86267]: INFO cinder.volume.manager [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 03:40:04 devstack cinder-volume[86267]: WARNING stevedore.named [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 03:40:04 devstack cinder-volume[86267]: WARNING castellan.key_manager [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 03:40:04 devstack cinder-volume[86267]: WARNING cinder.keymgr.conf_key_mgr [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 03:40:04 devstack cinder-volume[86267]: INFO cinder.volume.manager [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_db.sqlalchemy.engines [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86267) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:40:04 devstack cinder-volume[86267]: INFO oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Starting 1 workers Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Started child 86489 {{(pid=86267) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Full set of CONF: {{(pid=86267) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] ******************************************************************************** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Configuration options gathered from: {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] ================================================================================ {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] allow_availability_zone_fallback = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] allow_compression_on_image_upload = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] allowed_direct_url_schemes = [] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86489]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] api_rate_limit = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] auth_strategy = keystone {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_availability_zone = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_host = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_name = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_stats_polling_interval = 60 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backup_api_class = cinder.backup.api.API {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backup_name_template = backup-%s {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backup_use_same_host = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backup_use_temp_snapshot = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] changed_blocks_max_limit = 1000 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] changed_blocks_rpc_timeout = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] chap_password = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] chap_username = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cinder_internal_tenant_project_id = 22de91c65d2944b3b37d36b2bfa441f1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cinder_internal_tenant_user_id = 8935cc11956e4230a7bd271b34b68146 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cluster = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] compression_format = gzip {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] compute_api_class = cinder.compute.nova.API {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] config_dir = [] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] config_source = [] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] control_exchange = openstack {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] debug = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] default_availability_zone = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] default_group_type = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] default_volume_type = QuobyteHD {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] disk_geometry = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] driver_client_cert = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] driver_client_cert_key = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] driver_data_namespace = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] driver_ssl_cert_path = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] driver_ssl_cert_verify = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] driver_use_ssl = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] enable_new_services = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] enable_unsupported_driver = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] enabled_backends = ['QuobyteHD'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] enforce_multipath_for_image_xfer = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] filter_function = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance_api_insecure = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance_api_servers = ['http://192.168.122.102/image'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance_api_ssl_compression = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance_ca_certificates_file = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance_catalog_info = image:glance:publicURL {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance_certfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance_keyfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance_num_retries = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance_request_timeout = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] goodness_function = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] graceful_shutdown_timeout = 5 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] group_api_class = cinder.group.api.API {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] host = devstack {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] image_compress_on_upload = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] image_conversion_address_space_limit = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] image_conversion_cpu_limit = 60 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] image_conversion_disable = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] image_upload_use_cinder_backend = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] image_upload_use_internal_tenant = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] image_volume_cache_enabled = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] image_volume_cache_max_count = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] image_volume_cache_max_size_gb = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] init_host_max_objects_retrieval = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] instance_format = [instance: %(uuid)s] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] iscsi_target_flags = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] iscsi_write_cache = on {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] iser_helper = tgtadm {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] iser_ip_address = 192.168.122.102 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] iser_port = 3260 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] log_color = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] log_config_append = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] log_dir = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] log_file = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] log_options = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] log_rotate_interval = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] log_rotate_interval_type = days {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] log_rotation_type = none {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] max_age = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] max_logfile_count = 30 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] max_logfile_size_mb = 200 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Starting volume driver QuobyteDriver (1.2) Nov 05 03:40:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.remotefs [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86489) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] max_over_subscription_ratio = 20.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] message_reap_interval = 86400 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] message_ttl = 2592000 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] migration_create_volume_timeout_secs = 300 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] monkey_patch = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] monkey_patch_modules = [] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] my_ip = 192.168.122.102 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] no_snapshot_gb_quota = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] num_iser_scan_tries = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] num_shell_tries = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] num_volume_device_scan_tries = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] nvmeof_conn_info_version = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] nvmet_ns_id = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] nvmet_port_id = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] osapi_max_limit = 1000 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] osapi_volume_ext_list = [] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] osapi_volume_listen_port = 8776 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] osapi_volume_use_ssl = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] osapi_volume_workers = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] per_volume_size_limit = -1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] periodic_fuzzy_delay = 60 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] periodic_interval = 60 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] public_endpoint = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] publish_errors = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] quota_backup_gigabytes = 1000 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] quota_backups = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] quota_gigabytes = 1000 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] quota_groups = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] quota_snapshots = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] quota_volumes = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] rate_limit_burst = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] rate_limit_except_level = CRITICAL {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] rate_limit_interval = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] reinit_driver_count = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] replication_device = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] report_discard_supported = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] report_interval = 120 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] reservation_clean_interval = 86400 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] reservation_expire = 86400 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] reserved_image_namespaces = [] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] reserved_percentage = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] rpc_response_timeout = 120 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] run_external_periodic_tasks = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] scst_target_driver = iscsi {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] scst_target_iqn_name = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] service_down_time = 720 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] shell_completion = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] snapshot_name_template = snapshot-%s {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] split_loggers = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] state_path = /opt/stack/data/cinder {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] storage_availability_zone = nova {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] storage_protocol = iSCSI {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] syslog_log_facility = LOG_USER {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] target_helper = lioadm {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] target_ip_address = 192.168.122.102 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] target_port = 3260 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] target_protocol = iscsi {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] target_secondary_ip_addresses = [] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] trace_flags = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] transport_url = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] until_refresh = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] use_chap_auth = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] use_default_quota_class = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] use_journal = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] use_json = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] use_multipath_for_image_xfer = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] use_stderr = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] use_syslog = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] verify_glance_signatures = enabled {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] volume_api_class = cinder.volume.api.API {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] volume_backend_name = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] volume_clear = zero {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] volume_clear_ionice = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] volume_clear_size = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] volume_copy_bps_limit = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] volume_dd_blocksize = 1M {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] volume_name_template = volume-%s {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] volume_service_inithost_offload = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] volume_usage_audit_period = month {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] zoning_mode = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_concurrency.disable_process_locking = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.auth_section = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.auth_type = password {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.auth_version = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.cache = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.certfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.include_service_catalog = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.insecure = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.interface = public {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.keyfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.memcache_password = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.memcache_username = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.region_name = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.service_type = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86489) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Nov 05 03:40:04 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.quobyte [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 03:40:04 devstack cinder-volume[86489]: WARNING cinder.volume.drivers.quobyte [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.102/identity {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.backend = dogpile.cache.null {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.backend_argument = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.backend_expiration_time = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.config_prefix = cache.oslo {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.debug_cache_backend = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.enable_retry_client = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.enable_socket_keepalive = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.enabled = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.expiration_time = 600 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Running cmd (subprocess): mount.quobyte {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.hashclient_retry_attempts = 2 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.memcache_dead_retry = 300 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.memcache_pool_maxsize = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.memcache_sasl_enabled = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.password = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.proxies = [] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.redis_db = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.redis_server = localhost:6379 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.retry_attempts = 2 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.retry_delay = 0.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.socket_keepalive_count = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.socket_keepalive_idle = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.socket_keepalive_interval = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.socket_timeout = 1.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.tls_allowed_ciphers = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.tls_cafile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.tls_certfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.tls_enabled = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.tls_keyfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cache.username = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] coordination.backend_url = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.asyncio_connection = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.asyncio_slave_connection = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.backend = sqlalchemy {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.connection = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.connection_debug = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.connection_parameters = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.connection_recycle_time = 3600 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.connection_trace = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.db_inc_retry_interval = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.db_max_retries = 20 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.db_max_retry_interval = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.db_retry_interval = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.max_overflow = 50 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.max_pool_size = 5 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.max_retries = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.mysql_wsrep_sync_wait = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.pool_timeout = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.retry_interval = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.slave_connection = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.sqlite_synchronous = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.synchronous_reader = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] database.use_db_reconnect = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_tracing.insecure = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] profiler.connection_string = messaging:// {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] profiler.enabled = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] profiler.es_doc_type = notification {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] profiler.es_scroll_size = 10000 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] profiler.es_scroll_time = 2m {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] profiler.filter_error_trace = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] profiler.hmac_keys = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] profiler.sentinel_service_name = mymaster {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] profiler.socket_timeout = 0.1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] profiler.trace_requests = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] profiler.trace_sqlalchemy = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] profiler_jaeger.process_tags = {} {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] profiler_jaeger.service_name_prefix = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] profiler_otlp.service_name_prefix = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_policy.enforce_new_defaults = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_policy.policy_default_rule = default {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_policy.policy_file = policy.yaml {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] privsep_osbrick.group = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] privsep_osbrick.helper_command = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] privsep_osbrick.user = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cinder_sys_admin.group = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cinder_sys_admin.helper_command = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] cinder_sys_admin.user = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] service_user.auth_section = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] service_user.auth_type = password {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] service_user.cafile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] service_user.certfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] service_user.collect_timing = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] service_user.insecure = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] service_user.keyfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] service_user.send_service_user_token = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] service_user.split_loggers = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] service_user.timeout = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] service_user.tls_ciphers = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] service_user.tls_min_version = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance.auth_section = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance.auth_type = password {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance.certfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance.collect_timing = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance.insecure = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance.keyfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance.region_name = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance.split_loggers = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance.timeout = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance.tls_ciphers = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] glance.tls_min_version = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.backend_availability_zone = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.chap_password = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.chap_username = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack quobyte-client[86490]: Reading configuration file: /etc/quobyte/client.cfg Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.disk_geometry = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.driver_client_cert = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.driver_client_cert_key = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.driver_data_namespace = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack quobyte-client[86490]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.driver_use_ssl = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.extra_capabilities = {} {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.filter_function = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.goodness_function = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] CMD "mount.quobyte" returned: 1 in 0.113s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:40:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:40:04 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.iscsi_target_flags = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.iscsi_write_cache = on {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.iser_helper = tgtadm {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.iser_ip_address = 192.168.122.102 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.iser_port = 3260 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.nas_host = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.nas_login = admin {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.nas_mount_options = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.nas_password = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86489]: INFO cinder.volume.drivers.quobyte [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 ... Nov 05 03:40:04 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea -c /etc/quobyte/client-cinder.cfg {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.nas_private_key = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.nas_share_path = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.num_shell_tries = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.quobyte_volume_url = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.replication_device = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.report_discard_supported = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.reserved_percentage = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.target_helper = tgtadm {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.target_ip_address = 192.168.122.102 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.target_port = 3260 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.target_protocol = iscsi {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.trace_flags = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.unique_fqdn_network = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.use_chap_auth = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.volume_backend_name = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.volume_clear = zero {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.volume_clear_ionice = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.volume_clear_size = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_reports.file_event_handler = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack sudo[86493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea -c /etc/quobyte/client-cinder.cfg Nov 05 03:40:04 devstack sudo[86493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_reports.log_dir = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.backend_availability_zone = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.backend_host = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.chap_password = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.chap_username = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.chiscsi_conf = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.disk_geometry = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.driver_client_cert = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.driver_data_namespace = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.driver_use_ssl = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.extra_capabilities = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.filter_function = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.goodness_function = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.iser_helper = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.iser_ip_address = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.iser_port = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.iser_target_prefix = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.nas_host = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.nas_login = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.nas_mount_options = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.nas_password = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.nas_private_key = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.nas_share_path = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.nas_ssh_port = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.num_shell_tries = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.nvmet_port_id = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.replication_device = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.report_discard_supported = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.reserved_percentage = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.scst_target_driver = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.storage_protocol = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.target_helper = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.target_ip_address = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.target_port = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.target_prefix = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.target_protocol = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.trace_flags = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.use_chap_auth = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.volume_clear = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.volume_clear_size = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] QuobyteHD.volumes_dir = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.ssl = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_notifications.driver = [] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_notifications.retry = -1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] key_manager.fixed_key = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican.barbican_api_version = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican.barbican_endpoint = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican.barbican_endpoint_type = public {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican.barbican_region_name = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican.cafile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican.certfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican.collect_timing = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican.insecure = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican.keyfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican.number_of_retries = 60 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican.retry_delay = 1 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican.send_service_user_token = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican.split_loggers = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican.timeout = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican.tls_ciphers = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican.tls_min_version = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican.verify_ssl = True {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican.verify_ssl_path = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican_service_user.auth_section = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican_service_user.auth_type = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican_service_user.cafile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican_service_user.certfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican_service_user.collect_timing = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican_service_user.insecure = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican_service_user.keyfile = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican_service_user.split_loggers = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican_service_user.timeout = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican_service_user.tls_ciphers = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] barbican_service_user.tls_min_version = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] vault.approle_role_id = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] vault.approle_secret_id = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] vault.auth_method = approle {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] vault.auth_path = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] vault.kv_mountpoint = secret {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] vault.kv_path = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] vault.kv_version = 2 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] vault.namespace = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] vault.root_token_id = **** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] vault.ssl_ca_crt_file = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] vault.timeout = 60.0 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] vault.token_file = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] vault.token_role = None {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] vault.use_ssl = False {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:04 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] ******************************************************************************** {{(pid=86267) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 03:40:05 devstack sudo[86493]: pam_unix(sudo:session): session closed for user root Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.448s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:05 devstack cinder-volume[86489]: INFO cinder.volume.drivers.quobyte [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 succeeded Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.473s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:05 devstack sudo[86603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:40:05 devstack sudo[86603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:40:05 devstack sudo[86603]: pam_unix(sudo:session): session closed for user root Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.226s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:05 devstack cinder-volume[86489]: INFO cinder.volume.driver [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Driver hasn't implemented _init_vendor_properties() Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG cinder.volume.driver [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5555381774902, 'free_capacity_gb': 1773.5555381774902, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86489) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG oslo_db.sqlalchemy.engines [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86489) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG dbcounter [-] [86489] Writer thread running {{(pid=86489) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG cinder.db.api [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Building query based on filter {{(pid=86489) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3952}} Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG cinder.image.image_utils [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86489) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Nov 05 03:40:05 devstack cinder-volume[86489]: INFO cinder.keymgr.migration [None req-cd83b77b-b97f-4a23-80b7-848cff1a1297 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:05 devstack sudo[86606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:40:05 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:40:05 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.221s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:40:05 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Driver initialization completed successfully. Nov 05 03:40:05 devstack cinder-volume[86489]: INFO cinder.manager [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Initiating service 3 cleanup Nov 05 03:40:05 devstack cinder-volume[86489]: INFO cinder.manager [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Service 3 cleanup completed. Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG cinder.service [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Creating RPC server for service cinder-volume {{(pid=86489) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG cinder.service [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86489) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 03:40:05 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:40:05 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:05 devstack sudo[86610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:40:05 devstack sudo[86610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:40:06 devstack sudo[86610]: pam_unix(sudo:session): session closed for user root Nov 05 03:40:06 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.256s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:06 devstack cinder-volume[86489]: INFO cinder.volume.manager [None req-f9017ef9-d740-419a-9a9e-b71ab2e6540e None None] Driver post RPC initialization completed successfully. Nov 05 03:40:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e906f228-87f0-43ff-acd1-e709695926ad None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:40:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e906f228-87f0-43ff-acd1-e709695926ad None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:40:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e906f228-87f0-43ff-acd1-e709695926ad None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=86489) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:40:10 devstack cinder-volume[86489]: DEBUG cinder.volume.drivers.quobyte [None req-e906f228-87f0-43ff-acd1-e709695926ad None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=86489) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:40:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-e906f228-87f0-43ff-acd1-e709695926ad None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86489) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:40:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e906f228-87f0-43ff-acd1-e709695926ad None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:10 devstack sudo[86742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:40:10 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:40:10 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root Nov 05 03:40:10 devstack cinder-volume[86489]: DEBUG oslo_concurrency.processutils [None req-e906f228-87f0-43ff-acd1-e709695926ad None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.262s {{(pid=86489) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:10 devstack cinder-volume[86489]: DEBUG cinder.manager [None req-e906f228-87f0-43ff-acd1-e709695926ad None None] Notifying Schedulers of capabilities ... {{(pid=86489) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:40:11 devstack cinder-volume[86267]: INFO oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Caught SIGTERM, stopping children Nov 05 03:40:11 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Acquiring lock "singleton_lock" {{(pid=86267) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 03:40:11 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Acquired lock "singleton_lock" {{(pid=86267) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 03:40:11 devstack cinder-volume[86267]: DEBUG oslo_concurrency.lockutils [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Releasing lock "singleton_lock" {{(pid=86267) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 03:40:11 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Stop services. {{(pid=86267) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 03:40:11 devstack cinder-volume[86267]: DEBUG oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Killing children. {{(pid=86267) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 03:40:11 devstack cinder-volume[86267]: INFO oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Waiting on 1 children to exit Nov 05 03:40:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Acquiring lock "singleton_lock" {{(pid=86489) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 03:40:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Acquired lock "singleton_lock" {{(pid=86489) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 03:40:14 devstack cinder-volume[86489]: DEBUG oslo_concurrency.lockutils [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Releasing lock "singleton_lock" {{(pid=86489) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 03:40:14 devstack cinder-volume[86489]: WARNING amqp [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 03:40:14 devstack cinder-volume[86489]: WARNING amqp [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 03:40:14 devstack cinder-volume[86267]: INFO oslo_service.backend._eventlet.service [None req-19d9f243-7057-4a19-94f2-ecc2c030efa4 None None] Child 86489 exited with status 0 Nov 05 03:40:14 devstack cinder-volume[86815]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 03:40:14 devstack cinder-volume[86815]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 03:40:14 devstack cinder-volume[86815]: we strongly recommend against using it for new projects. Nov 05 03:40:14 devstack cinder-volume[86815]: If you are already using Eventlet, we recommend migrating to a different Nov 05 03:40:14 devstack cinder-volume[86815]: framework. For more detail see Nov 05 03:40:14 devstack cinder-volume[86815]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 03:40:14 devstack cinder-volume[86815]: import eventlet # noqa Nov 05 03:40:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 03:40:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 03:40:17 devstack cinder-volume[86815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 03:40:18 devstack cinder-volume[86815]: INFO dbcounter [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] Registered counter for database cinder Nov 05 03:40:18 devstack cinder-volume[86815]: DEBUG oslo_db.sqlalchemy.engines [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86815) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:40:18 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writer thread running {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 03:40:18 devstack cinder-volume[86815]: INFO cinder.rpc [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 03:40:18 devstack cinder-volume[86815]: INFO cinder.rpc [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_db.sqlalchemy.engines [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86815) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:40:19 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] Determined volume DB was empty at startup. Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG cinder.volume.manager [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86815) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} Nov 05 03:40:19 devstack cinder-volume[86815]: WARNING stevedore.named [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 03:40:19 devstack cinder-volume[86815]: WARNING castellan.key_manager [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 03:40:19 devstack cinder-volume[86815]: WARNING cinder.keymgr.conf_key_mgr [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 03:40:19 devstack cinder-volume[86815]: INFO cinder.volume.manager [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_db.sqlalchemy.engines [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86815) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:40:19 devstack cinder-volume[86815]: INFO oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] Starting 1 workers Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] Started child 87109 {{(pid=86815) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] Full set of CONF: {{(pid=86815) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] ******************************************************************************** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] Configuration options gathered from: {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] ================================================================================ {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] allow_availability_zone_fallback = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] allow_compression_on_image_upload = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] allowed_direct_url_schemes = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] api_rate_limit = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[87109]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] auth_strategy = keystone {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_availability_zone = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_host = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_stats_polling_interval = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backup_api_class = cinder.backup.api.API {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backup_name_template = backup-%s {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backup_use_same_host = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backup_use_temp_snapshot = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] changed_blocks_max_limit = 1000 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] changed_blocks_rpc_timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] chap_password = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] chap_username = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cinder_internal_tenant_project_id = 22de91c65d2944b3b37d36b2bfa441f1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cinder_internal_tenant_user_id = 8935cc11956e4230a7bd271b34b68146 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cluster = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] compression_format = gzip {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] compute_api_class = cinder.compute.nova.API {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] config_dir = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] config_source = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] control_exchange = openstack {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] debug = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] default_availability_zone = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] default_group_type = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] default_volume_type = QuobyteHD {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] disk_geometry = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] driver_client_cert = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] driver_client_cert_key = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] driver_data_namespace = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] driver_ssl_cert_path = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] driver_ssl_cert_verify = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] driver_use_ssl = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] enable_new_services = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] enable_unsupported_driver = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] enabled_backends = ['QuobyteHD'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] enforce_multipath_for_image_xfer = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] filter_function = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance_api_insecure = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance_api_servers = ['http://192.168.122.102/image'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance_api_ssl_compression = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance_ca_certificates_file = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance_catalog_info = image:glance:publicURL {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance_certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance_keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance_num_retries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance_request_timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] goodness_function = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] graceful_shutdown_timeout = 5 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] group_api_class = cinder.group.api.API {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] host = devstack {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] image_compress_on_upload = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] image_conversion_address_space_limit = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] image_conversion_cpu_limit = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] image_conversion_disable = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] image_upload_use_cinder_backend = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] image_upload_use_internal_tenant = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] image_volume_cache_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] image_volume_cache_max_count = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] image_volume_cache_max_size_gb = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] init_host_max_objects_retrieval = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] instance_format = [instance: %(uuid)s] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] iscsi_target_flags = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] iscsi_write_cache = on {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] iser_helper = tgtadm {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] iser_ip_address = 192.168.122.102 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] iser_port = 3260 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] log_color = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] log_config_append = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] log_dir = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] log_file = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] log_options = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] log_rotate_interval = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] log_rotate_interval_type = days {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] log_rotation_type = none {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] max_age = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] max_logfile_count = 30 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] max_logfile_size_mb = 200 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] max_over_subscription_ratio = 20.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] message_reap_interval = 86400 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] message_ttl = 2592000 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] migration_create_volume_timeout_secs = 300 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] monkey_patch = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] monkey_patch_modules = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] my_ip = 192.168.122.102 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] no_snapshot_gb_quota = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] num_iser_scan_tries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] num_shell_tries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] num_volume_device_scan_tries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] nvmeof_conn_info_version = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] nvmet_ns_id = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] nvmet_port_id = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] osapi_max_limit = 1000 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] osapi_volume_ext_list = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] osapi_volume_listen = 0.0.0.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] osapi_volume_listen_port = 8776 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] osapi_volume_use_ssl = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] osapi_volume_workers = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] per_volume_size_limit = -1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] periodic_fuzzy_delay = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] periodic_interval = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] project_id_regex = [0-9a-f\-]+ {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] public_endpoint = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] publish_errors = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] quota_backup_gigabytes = 1000 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] quota_backups = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] quota_gigabytes = 1000 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] quota_groups = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] quota_snapshots = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] quota_volumes = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] rate_limit_burst = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] rate_limit_except_level = CRITICAL {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] rate_limit_interval = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] reinit_driver_count = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] replication_device = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] report_discard_supported = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] report_interval = 120 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] reservation_clean_interval = 86400 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] reservation_expire = 86400 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] reserved_image_namespaces = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] reserved_percentage = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] rpc_response_timeout = 120 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] run_external_periodic_tasks = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] scst_target_driver = iscsi {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] scst_target_iqn_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] service_down_time = 720 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] shell_completion = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] snapshot_name_template = snapshot-%s {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] split_loggers = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] state_path = /opt/stack/data/cinder {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] storage_availability_zone = nova {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] storage_protocol = iSCSI {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] syslog_log_facility = LOG_USER {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] target_helper = lioadm {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] target_ip_address = 192.168.122.102 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] target_port = 3260 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] target_protocol = iscsi {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] target_secondary_ip_addresses = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] trace_flags = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] transfer_api_class = cinder.transfer.api.API {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] transport_url = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] until_refresh = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] use_chap_auth = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] use_default_quota_class = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] use_journal = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] use_json = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] use_multipath_for_image_xfer = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] use_stderr = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] use_syslog = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] verify_glance_signatures = enabled {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] volume_api_class = cinder.volume.api.API {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] volume_backend_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] volume_clear = zero {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] volume_clear_ionice = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] volume_clear_size = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] volume_copy_bps_limit = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] volume_dd_blocksize = 1M {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] volume_name_template = volume-%s {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] volume_service_inithost_offload = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] volume_usage_audit_period = month {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] zoning_mode = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_concurrency.disable_process_locking = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.auth_section = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.auth_type = password {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.auth_version = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.cache = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.delay_auth_decision = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.http_connect_timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.include_service_catalog = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.insecure = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.interface = public {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.memcache_password = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Starting volume driver QuobyteDriver (1.2) Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87109) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.memcache_username = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.region_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.service_token_roles_required = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.service_type = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.token_cache_time = 300 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.102/identity {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.backend = dogpile.cache.null {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.backend_argument = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.backend_expiration_time = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.config_prefix = cache.oslo {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.debug_cache_backend = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.enable_retry_client = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.enable_socket_keepalive = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.expiration_time = 600 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.hashclient_retry_attempts = 2 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.memcache_dead_retry = 300 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.memcache_pool_maxsize = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.memcache_sasl_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.password = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.proxies = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.redis_db = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.redis_sentinel_service_name = mymaster {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.redis_server = localhost:6379 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.retry_attempts = 2 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.retry_delay = 0.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.socket_keepalive_count = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.socket_keepalive_idle = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.socket_keepalive_interval = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.socket_timeout = 1.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.tls_allowed_ciphers = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.tls_cafile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.tls_certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.tls_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.tls_keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cache.username = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] coordination.backend_url = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.asyncio_connection = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.asyncio_slave_connection = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.backend = sqlalchemy {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.connection = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.connection_debug = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.connection_parameters = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.connection_recycle_time = 3600 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.connection_trace = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.db_inc_retry_interval = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.db_max_retries = 20 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.db_max_retry_interval = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.db_retry_interval = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.max_overflow = 50 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.max_pool_size = 5 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87109) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.max_retries = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.mysql_wsrep_sync_wait = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.pool_timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.retry_interval = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.quobyte [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 03:40:19 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.quobyte [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Running cmd (subprocess): mount.quobyte {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.slave_connection = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.sqlite_synchronous = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.synchronous_reader = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] database.use_db_reconnect = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_tracing.insecure = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] profiler.connection_string = messaging:// {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] profiler.enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] profiler.es_doc_type = notification {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] profiler.es_scroll_size = 10000 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] profiler.es_scroll_time = 2m {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] profiler.filter_error_trace = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] profiler.hmac_keys = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] profiler.sentinel_service_name = mymaster {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] profiler.socket_timeout = 0.1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] profiler.trace_requests = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] profiler.trace_sqlalchemy = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] profiler_jaeger.process_tags = {} {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] profiler_jaeger.service_name_prefix = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] profiler_otlp.service_name_prefix = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_policy.enforce_new_defaults = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_policy.policy_default_rule = default {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_policy.policy_file = policy.yaml {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_policy.remote_timeout = 60.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] privsep_osbrick.group = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] privsep_osbrick.helper_command = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] privsep_osbrick.user = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cinder_sys_admin.group = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cinder_sys_admin.helper_command = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] cinder_sys_admin.user = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] service_user.auth_section = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] service_user.auth_type = password {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] service_user.cafile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] service_user.certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] service_user.collect_timing = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] service_user.insecure = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] service_user.keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] service_user.send_service_user_token = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] service_user.split_loggers = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] service_user.timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] service_user.tls_ciphers = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] service_user.tls_min_version = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance.auth_section = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance.auth_type = password {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance.certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance.collect_timing = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance.insecure = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance.keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance.region_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance.split_loggers = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance.timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance.tls_ciphers = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] glance.tls_min_version = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.backend_availability_zone = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.chap_password = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.chap_username = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.disk_geometry = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.driver_client_cert = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.driver_client_cert_key = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.driver_data_namespace = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.driver_use_ssl = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.enable_unsupported_driver = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.extra_capabilities = {} {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.filter_function = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.goodness_function = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.iscsi_target_flags = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.iscsi_write_cache = on {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.iser_helper = tgtadm {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.iser_ip_address = 192.168.122.102 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.iser_port = 3260 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.nas_host = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.nas_login = admin {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.nas_mount_options = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.nas_password = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.nas_private_key = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.nas_share_path = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.nas_ssh_port = 22 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.num_shell_tries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.nvmet_port_id = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.quobyte_client_cfg = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.quobyte_volume_url = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.replication_device = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.report_discard_supported = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.reserved_percentage = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.scst_target_driver = iscsi {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.scst_target_iqn_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.storage_protocol = iSCSI {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.target_helper = tgtadm {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.target_ip_address = 192.168.122.102 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.target_port = 3260 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.target_protocol = iscsi {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.trace_flags = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack quobyte-client[87115]: Reading configuration file: /etc/quobyte/client.cfg Nov 05 03:40:19 devstack quobyte-client[87115]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.unique_fqdn_network = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.use_chap_auth = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.volume_backend_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.volume_clear = zero {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.volume_clear_ionice = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.volume_clear_size = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_reports.file_event_handler = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] CMD "mount.quobyte" returned: 1 in 0.069s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_reports.log_dir = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.backend_availability_zone = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.backend_host = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.chap_password = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.chap_username = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.chiscsi_conf = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.disk_geometry = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.driver_client_cert = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.driver_client_cert_key = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.driver_data_namespace = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.driver_use_ssl = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.extra_capabilities = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.filter_function = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.goodness_function = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.iscsi_target_flags = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.iscsi_write_cache = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.iser_helper = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.iser_ip_address = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.iser_port = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.iser_target_prefix = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.nas_host = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.nas_login = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.nas_mount_options = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.nas_password = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.nas_private_key = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.nas_share_path = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.nas_ssh_port = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.num_shell_tries = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.nvmet_ns_id = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.nvmet_port_id = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.replication_device = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.report_discard_supported = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.reserved_percentage = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.scst_target_driver = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.storage_protocol = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.target_helper = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.target_ip_address = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.target_port = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.target_prefix = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.target_protocol = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.trace_flags = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.unique_fqdn_network = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.use_chap_auth = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.volume_clear = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.volume_clear_ionice = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.volume_clear_size = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] QuobyteHD.volumes_dir = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack sudo[87116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.ssl = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.ssl_version = {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_notifications.driver = [] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_notifications.retry = -1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] oslo_messaging_notifications.transport_url = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] key_manager.fixed_key = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican.barbican_api_version = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican.barbican_endpoint = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican.barbican_endpoint_type = public {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican.barbican_region_name = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican.cafile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican.certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican.collect_timing = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican.insecure = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican.keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican.number_of_retries = 60 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican.retry_delay = 1 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican.send_service_user_token = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican.split_loggers = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican.timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican.tls_ciphers = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican.tls_min_version = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican.verify_ssl = True {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican.verify_ssl_path = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican_service_user.auth_section = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican_service_user.auth_type = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican_service_user.cafile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican_service_user.certfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican_service_user.collect_timing = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican_service_user.insecure = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican_service_user.keyfile = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican_service_user.split_loggers = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican_service_user.timeout = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican_service_user.tls_ciphers = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] barbican_service_user.tls_min_version = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] vault.approle_role_id = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] vault.approle_secret_id = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] vault.auth_method = approle {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] vault.auth_path = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] vault.kv_mountpoint = secret {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] vault.kv_path = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] vault.kv_version = 2 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] vault.namespace = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] vault.root_token_id = **** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] vault.ssl_ca_crt_file = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] vault.timeout = 60.0 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] vault.token_file = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] vault.token_role = None {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] vault.use_ssl = False {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 03:40:19 devstack cinder-volume[86815]: DEBUG oslo_service.backend._eventlet.service [None req-b1823e02-83c3-44dc-ac15-96c5136161db None None] ******************************************************************************** {{(pid=86815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 03:40:19 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.236s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:19 devstack cinder-volume[87109]: INFO cinder.volume.driver [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG cinder.volume.driver [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5555381774902, 'free_capacity_gb': 1773.5555381774902, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87109) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG oslo_db.sqlalchemy.engines [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87109) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writer thread running {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG cinder.db.api [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Building query based on filter {{(pid=87109) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3952}} Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87109) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:40:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:19 devstack cinder-volume[87109]: INFO cinder.keymgr.migration [None req-6e2141c1-b369-4b34-9d48-b3971cba4eb3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 03:40:19 devstack sudo[87127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:40:19 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:40:20 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root Nov 05 03:40:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.228s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:20 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:40:20 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Driver initialization completed successfully. Nov 05 03:40:20 devstack cinder-volume[87109]: INFO cinder.manager [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Initiating service 3 cleanup Nov 05 03:40:20 devstack cinder-volume[87109]: INFO cinder.manager [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Service 3 cleanup completed. Nov 05 03:40:20 devstack cinder-volume[87109]: DEBUG cinder.service [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Creating RPC server for service cinder-volume {{(pid=87109) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 03:40:20 devstack cinder-volume[87109]: DEBUG cinder.service [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87109) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 03:40:20 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Nov 05 03:40:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:40:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:40:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:40:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:40:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:40:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:40:20 devstack sudo[87138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:40:20 devstack sudo[87138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:40:20 devstack sudo[87138]: pam_unix(sudo:session): session closed for user root Nov 05 03:40:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.234s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:40:20 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-7294a414-a1a3-40e3-a0a0-8822973ba302 None None] Driver post RPC initialization completed successfully. Nov 05 03:40:29 devstack cinder-volume[86815]: DEBUG dbcounter [-] [86815] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:40:30 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=2 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:40:30 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:40:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:40:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 6 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:40:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Flow 'volume_create_manager' (1bb22f8d-ba88-4ba9-a4ce-abd377d48473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3690e56d-f8b2-48b6-8955-f31de7bb840b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3690e56d-f8b2-48b6-8955-f31de7bb840b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-806165300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6a4583-2932-4151-8029-ad928bfcc9ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36fef4dba83841039e781a412c0f6c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:41:19Z,use_quota=True,user_id='830f5bd558984c98955f43faac3b021d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e1dce26-f854-437a-8b8e-537cf8781e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e1dce26-f854-437a-8b8e-537cf8781e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28fc6baa-d67c-4b0d-9c62-dc02f436cc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28fc6baa-d67c-4b0d-9c62-dc02f436cc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de6a4583-2932-4151-8029-ad928bfcc9ac', 'volume_name': 'volume-de6a4583-2932-4151-8029-ad928bfcc9ac', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6daa75bb-2ea1-4d6b-8076-adbfb58a4dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6daa75bb-2ea1-4d6b-8076-adbfb58a4dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72f039e-6f54-46fd-a49f-b28ca34f37cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:41:19 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Volume de6a4583-2932-4151-8029-ad928bfcc9ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de6a4583-2932-4151-8029-ad928bfcc9ac', 'volume_size': 1} Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-806165300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6a4583-2932-4151-8029-ad928bfcc9ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36fef4dba83841039e781a412c0f6c34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:41:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:41:19Z,use_quota=True,user_id='830f5bd558984c98955f43faac3b021d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Creating volume de6a4583-2932-4151-8029-ad928bfcc9ac {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:41:19 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:41:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-de6a4583-2932-4151-8029-ad928bfcc9ac 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:41:19 devstack sudo[87502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-de6a4583-2932-4151-8029-ad928bfcc9ac 1073741824 Nov 05 03:41:19 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:41:20 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root Nov 05 03:41:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-de6a4583-2932-4151-8029-ad928bfcc9ac 1073741824" returned: 0 in 0.654s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:41:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-de6a4583-2932-4151-8029-ad928bfcc9ac {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:41:20 devstack sudo[87822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-de6a4583-2932-4151-8029-ad928bfcc9ac Nov 05 03:41:20 devstack sudo[87822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:41:20 devstack sudo[87822]: pam_unix(sudo:session): session closed for user root Nov 05 03:41:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-de6a4583-2932-4151-8029-ad928bfcc9ac" returned: 0 in 0.273s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:41:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:41:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:41:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72f039e-6f54-46fd-a49f-b28ca34f37cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de6a4583-2932-4151-8029-ad928bfcc9ac', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:41:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c01faa-7e62-4ff6-a3ac-8cfde037d12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:41:20 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Volume volume-de6a4583-2932-4151-8029-ad928bfcc9ac (de6a4583-2932-4151-8029-ad928bfcc9ac): created successfully Nov 05 03:41:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c01faa-7e62-4ff6-a3ac-8cfde037d12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:41:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Flow 'volume_create_manager' (1bb22f8d-ba88-4ba9-a4ce-abd377d48473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:41:20 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f2e83525-fdaa-4744-94b3-4cd8273684de tempest-TaggedAttachmentsTest-1297816677 None] Created volume successfully. Nov 05 03:41:30 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:41:30 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:41:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:41:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:41:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:41:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:41:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:41:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:41:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:41:58 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:41:58 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Flow 'volume_create_manager' (f16b857b-a0d6-47bb-86d7-e7b5bc89cd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9274a0-1840-43b1-a4af-c4057688166a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9274a0-1840-43b1-a4af-c4057688166a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2130963813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d91d96b4-dace-43c9-b8be-358b990ac478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7dd6d8fa61458d8731ff887a1897f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:41:59Z,use_quota=True,user_id='c61de27efd21452e9df24825317d9f6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (227c6cbd-7737-4ec3-9ba0-d8a2f814e7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (227c6cbd-7737-4ec3-9ba0-d8a2f814e7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45726cd6-0989-44ce-a6e5-dfb88a883f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45726cd6-0989-44ce-a6e5-dfb88a883f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd91d96b4-dace-43c9-b8be-358b990ac478', 'volume_name': 'volume-d91d96b4-dace-43c9-b8be-358b990ac478', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88649ddb-2625-408c-a699-aa3f39e1b3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88649ddb-2625-408c-a699-aa3f39e1b3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb9620a-b8ea-47aa-854b-41f32b98aad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:41:59 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Volume d91d96b4-dace-43c9-b8be-358b990ac478: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d91d96b4-dace-43c9-b8be-358b990ac478', 'volume_size': 1} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2130963813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d91d96b4-dace-43c9-b8be-358b990ac478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de7dd6d8fa61458d8731ff887a1897f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:41:59Z,use_quota=True,user_id='c61de27efd21452e9df24825317d9f6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Creating volume d91d96b4-dace-43c9-b8be-358b990ac478 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:41:59 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d91d96b4-dace-43c9-b8be-358b990ac478 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:41:59 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d91d96b4-dace-43c9-b8be-358b990ac478 1073741824 Nov 05 03:41:59 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:41:59 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 1.373s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 6 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:41:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:42:00 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d91d96b4-dace-43c9-b8be-358b990ac478 1073741824" returned: 0 in 0.960s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d91d96b4-dace-43c9-b8be-358b990ac478 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:00 devstack sudo[88356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d91d96b4-dace-43c9-b8be-358b990ac478 Nov 05 03:42:00 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:01 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d91d96b4-dace-43c9-b8be-358b990ac478" returned: 0 in 0.680s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:42:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb9620a-b8ea-47aa-854b-41f32b98aad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d91d96b4-dace-43c9-b8be-358b990ac478', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01ab93b-f26f-49c2-976f-9f73ad6ffdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:01 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Volume volume-d91d96b4-dace-43c9-b8be-358b990ac478 (d91d96b4-dace-43c9-b8be-358b990ac478): created successfully Nov 05 03:42:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01ab93b-f26f-49c2-976f-9f73ad6ffdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Flow 'volume_create_manager' (f16b857b-a0d6-47bb-86d7-e7b5bc89cd49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:42:01 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-6fda9411-43e0-4041-acc4-6fa39c3da23a tempest-VolumesAdminNegativeTest-1814901901 None] Created volume successfully. Nov 05 03:42:04 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Acquiring lock "cinder-d91d96b4-dace-43c9-b8be-358b990ac478-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:42:04 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Lock "cinder-d91d96b4-dace-43c9-b8be-358b990ac478-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:42:05 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Acquiring lock "cinder-quobyte-d91d96b4-dace-43c9-b8be-358b990ac478" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:42:05 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Lock "cinder-quobyte-d91d96b4-dace-43c9-b8be-358b990ac478" acquired by "delete_volume" :: waited 0.064s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:42:05 devstack cinder-volume[87109]: INFO oslo.privsep.daemon [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpnvbgs0ip/privsep.sock'] Nov 05 03:42:05 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpnvbgs0ip/privsep.sock Nov 05 03:42:05 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:06 devstack cinder-volume[87109]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 05 03:42:06 devstack cinder-volume[87109]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 03:42:06 devstack cinder-volume[87109]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 05 03:42:06 devstack cinder-volume[87109]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 03:42:06 devstack cinder-volume[87109]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 05 03:42:06 devstack cinder-volume[87109]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 05 03:42:06 devstack cinder-volume[87109]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 03:42:06 devstack cinder-volume[87109]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 03:42:06 devstack cinder-volume[87109]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 05 03:42:07 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:07 devstack cinder-volume[87109]: INFO oslo.privsep.daemon [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Spawned new privsep daemon via rootwrap Nov 05 03:42:07 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Accepted privsep connection to /tmp/tmpnvbgs0ip/privsep.sock {{(pid=87109) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 05 03:42:07 devstack cinder-volume[87109]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 05 03:42:07 devstack cinder-volume[87109]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 05 03:42:07 devstack cinder-volume[87109]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 05 03:42:07 devstack cinder-volume[87109]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88399 Nov 05 03:42:07 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c42959-0926-4179-8a87-46edcc0b01ac]: (2,) {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:42:07 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefa0e08-7a25-4f55-b735-8c8b33381df2]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:42:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d91d96b4-dace-43c9-b8be-358b990ac478 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:07 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d91d96b4-dace-43c9-b8be-358b990ac478 Nov 05 03:42:07 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:08 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d91d96b4-dace-43c9-b8be-358b990ac478" returned: 0 in 1.078s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d91d96b4-dace-43c9-b8be-358b990ac478 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:08 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d91d96b4-dace-43c9-b8be-358b990ac478 Nov 05 03:42:08 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:08 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d91d96b4-dace-43c9-b8be-358b990ac478" returned: 0 in 0.707s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Lock "cinder-quobyte-d91d96b4-dace-43c9-b8be-358b990ac478" released by "delete_volume" :: held 3.662s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:42:09 devstack cinder-volume[87109]: WARNING cinder.quota [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:42:09 devstack cinder-volume[87109]: WARNING cinder.quota [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:42:09 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Created reservations ['8f0e4bd9-80bc-4f56-ac09-3cc72b457ea7', '7d74bbab-801f-47fc-a2af-9f2ab0f23276', '857e0a9d-5069-40e7-9f2b-a97c82decf2e', '958e222d-d9ed-43ac-bcf3-b25ee61d2662'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:42:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:42:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:42:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:09 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:42:09 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:09 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.478s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:10 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:42:10 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Deleted volume successfully. Nov 05 03:42:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f4cdf227-2705-4ef8-a19b-ff501c03c5fa tempest-VolumesAdminNegativeTest-1814901901 None] Lock "cinder-d91d96b4-dace-43c9-b8be-358b990ac478-delete_volume" released by "delete_volume" :: held 5.214s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Flow 'volume_create_manager' (e4a0951b-293c-495b-8f62-225e50fd7e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdea0bd2-f239-41fe-b457-00531ce6d905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdea0bd2-f239-41fe-b457-00531ce6d905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1243013343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc00b810-c277-4d28-bbed-441e83ae17aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8bb0433871948ee8f6646e354caaf8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:12Z,use_quota=True,user_id='642bf25738464e599d4c57ca841b112d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20871f47-adef-4cb6-bfcb-ac7f2412124b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20871f47-adef-4cb6-bfcb-ac7f2412124b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6825d6-326c-450d-ac7b-e05b5c34647d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db6825d6-326c-450d-ac7b-e05b5c34647d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc00b810-c277-4d28-bbed-441e83ae17aa', 'volume_name': 'volume-bc00b810-c277-4d28-bbed-441e83ae17aa', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b309306-1d05-43fa-8f23-cab009468834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b309306-1d05-43fa-8f23-cab009468834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b162514b-126e-4c1e-bb55-452ba6e615c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:12 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Volume bc00b810-c277-4d28-bbed-441e83ae17aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc00b810-c277-4d28-bbed-441e83ae17aa', 'volume_size': 1} Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1243013343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc00b810-c277-4d28-bbed-441e83ae17aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8bb0433871948ee8f6646e354caaf8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:12Z,use_quota=True,user_id='642bf25738464e599d4c57ca841b112d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Creating volume bc00b810-c277-4d28-bbed-441e83ae17aa {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:42:12 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:42:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc00b810-c277-4d28-bbed-441e83ae17aa 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:12 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc00b810-c277-4d28-bbed-441e83ae17aa 1073741824 Nov 05 03:42:12 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:13 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc00b810-c277-4d28-bbed-441e83ae17aa 1073741824" returned: 0 in 0.745s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc00b810-c277-4d28-bbed-441e83ae17aa {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:13 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc00b810-c277-4d28-bbed-441e83ae17aa Nov 05 03:42:13 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:14 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc00b810-c277-4d28-bbed-441e83ae17aa" returned: 0 in 0.472s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:42:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b162514b-126e-4c1e-bb55-452ba6e615c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc00b810-c277-4d28-bbed-441e83ae17aa', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1852bc9-0bd0-4589-b12b-a97b276598e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:14 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Volume volume-bc00b810-c277-4d28-bbed-441e83ae17aa (bc00b810-c277-4d28-bbed-441e83ae17aa): created successfully Nov 05 03:42:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1852bc9-0bd0-4589-b12b-a97b276598e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Flow 'volume_create_manager' (e4a0951b-293c-495b-8f62-225e50fd7e6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:42:14 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-a496db21-e694-4214-955e-7e64540511a2 tempest-ServersNegativeTestJSON-1450956313 None] Created volume successfully. Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Flow 'volume_create_manager' (7add49b6-0eb7-4b3f-a0c3-336c62b4e796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b7e4a3-abcb-4fcd-bd9d-e495a565c2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22b7e4a3-abcb-4fcd-bd9d-e495a565c2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-79506687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86319203-1a34-4b3f-9ff2-1bc00d3a7c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8bb0433871948ee8f6646e354caaf8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:20Z,use_quota=True,user_id='642bf25738464e599d4c57ca841b112d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32114d21-4799-44df-9976-6cb9815cc715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32114d21-4799-44df-9976-6cb9815cc715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40718af8-bbf4-47ef-acbd-df65c4d7cfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40718af8-bbf4-47ef-acbd-df65c4d7cfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86319203-1a34-4b3f-9ff2-1bc00d3a7c09', 'volume_name': 'volume-86319203-1a34-4b3f-9ff2-1bc00d3a7c09', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd7bd96-3776-4e06-ac51-4772803fe7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd7bd96-3776-4e06-ac51-4772803fe7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ab3bd1-d700-488c-a9be-814ca02481ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:20 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Volume 86319203-1a34-4b3f-9ff2-1bc00d3a7c09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86319203-1a34-4b3f-9ff2-1bc00d3a7c09', 'volume_size': 1} Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-79506687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86319203-1a34-4b3f-9ff2-1bc00d3a7c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8bb0433871948ee8f6646e354caaf8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:20Z,use_quota=True,user_id='642bf25738464e599d4c57ca841b112d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Creating volume 86319203-1a34-4b3f-9ff2-1bc00d3a7c09 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:42:20 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:42:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86319203-1a34-4b3f-9ff2-1bc00d3a7c09 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:20 devstack sudo[88507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86319203-1a34-4b3f-9ff2-1bc00d3a7c09 1073741824 Nov 05 03:42:20 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:21 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86319203-1a34-4b3f-9ff2-1bc00d3a7c09 1073741824" returned: 0 in 0.701s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86319203-1a34-4b3f-9ff2-1bc00d3a7c09 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:21 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86319203-1a34-4b3f-9ff2-1bc00d3a7c09 Nov 05 03:42:21 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:21 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86319203-1a34-4b3f-9ff2-1bc00d3a7c09" returned: 0 in 0.283s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:42:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ab3bd1-d700-488c-a9be-814ca02481ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86319203-1a34-4b3f-9ff2-1bc00d3a7c09', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a23e19d-5cde-4b20-987f-a8fd0d17c16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:21 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Volume volume-86319203-1a34-4b3f-9ff2-1bc00d3a7c09 (86319203-1a34-4b3f-9ff2-1bc00d3a7c09): created successfully Nov 05 03:42:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a23e19d-5cde-4b20-987f-a8fd0d17c16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Flow 'volume_create_manager' (7add49b6-0eb7-4b3f-a0c3-336c62b4e796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:42:21 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-82af90ad-448f-4dac-8e06-8901ef412e40 tempest-ServersNegativeTestJSON-1450956313 None] Created volume successfully. Nov 05 03:42:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d615c04f-11c0-4af0-a897-34074a0a0630 tempest-ServersNegativeTestJSON-1450956313 None] Acquiring lock "cinder-86319203-1a34-4b3f-9ff2-1bc00d3a7c09-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:42:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d615c04f-11c0-4af0-a897-34074a0a0630 tempest-ServersNegativeTestJSON-1450956313 None] Lock "cinder-86319203-1a34-4b3f-9ff2-1bc00d3a7c09-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:42:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d615c04f-11c0-4af0-a897-34074a0a0630 tempest-ServersNegativeTestJSON-1450956313 None] Acquiring lock "cinder-quobyte-86319203-1a34-4b3f-9ff2-1bc00d3a7c09" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:42:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d615c04f-11c0-4af0-a897-34074a0a0630 tempest-ServersNegativeTestJSON-1450956313 None] Lock "cinder-quobyte-86319203-1a34-4b3f-9ff2-1bc00d3a7c09" acquired by "delete_volume" :: waited 0.014s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:42:26 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3d6ffb-51d0-4ad8-8b6a-7aa7f3a3457d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:42:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d615c04f-11c0-4af0-a897-34074a0a0630 tempest-ServersNegativeTestJSON-1450956313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86319203-1a34-4b3f-9ff2-1bc00d3a7c09 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:26 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86319203-1a34-4b3f-9ff2-1bc00d3a7c09 Nov 05 03:42:26 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:26 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d615c04f-11c0-4af0-a897-34074a0a0630 tempest-ServersNegativeTestJSON-1450956313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86319203-1a34-4b3f-9ff2-1bc00d3a7c09" returned: 0 in 0.520s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d615c04f-11c0-4af0-a897-34074a0a0630 tempest-ServersNegativeTestJSON-1450956313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86319203-1a34-4b3f-9ff2-1bc00d3a7c09 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:26 devstack sudo[88525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86319203-1a34-4b3f-9ff2-1bc00d3a7c09 Nov 05 03:42:26 devstack sudo[88525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:26 devstack sudo[88525]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d615c04f-11c0-4af0-a897-34074a0a0630 tempest-ServersNegativeTestJSON-1450956313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86319203-1a34-4b3f-9ff2-1bc00d3a7c09" returned: 0 in 0.287s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d615c04f-11c0-4af0-a897-34074a0a0630 tempest-ServersNegativeTestJSON-1450956313 None] Lock "cinder-quobyte-86319203-1a34-4b3f-9ff2-1bc00d3a7c09" released by "delete_volume" :: held 0.880s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:42:27 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-d615c04f-11c0-4af0-a897-34074a0a0630 tempest-ServersNegativeTestJSON-1450956313 None] Created reservations ['34fa94bc-06f5-46ba-bab9-53f88e705a31', 'b1e1c134-ba58-4baa-ac6b-90dd1e8bf769', 'b57be8cf-9c00-4d24-9eb0-d725c685cb0d', '9e0a715a-a719-4bf1-9f69-e1fe17488635'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:42:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d615c04f-11c0-4af0-a897-34074a0a0630 tempest-ServersNegativeTestJSON-1450956313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d615c04f-11c0-4af0-a897-34074a0a0630 tempest-ServersNegativeTestJSON-1450956313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:27 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d615c04f-11c0-4af0-a897-34074a0a0630 tempest-ServersNegativeTestJSON-1450956313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:42:27 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d615c04f-11c0-4af0-a897-34074a0a0630 tempest-ServersNegativeTestJSON-1450956313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:42:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d615c04f-11c0-4af0-a897-34074a0a0630 tempest-ServersNegativeTestJSON-1450956313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d615c04f-11c0-4af0-a897-34074a0a0630 tempest-ServersNegativeTestJSON-1450956313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:27 devstack sudo[88530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:42:27 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:27 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d615c04f-11c0-4af0-a897-34074a0a0630 tempest-ServersNegativeTestJSON-1450956313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.307s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:27 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-d615c04f-11c0-4af0-a897-34074a0a0630 tempest-ServersNegativeTestJSON-1450956313 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:42:27 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-d615c04f-11c0-4af0-a897-34074a0a0630 tempest-ServersNegativeTestJSON-1450956313 None] Deleted volume successfully. Nov 05 03:42:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d615c04f-11c0-4af0-a897-34074a0a0630 tempest-ServersNegativeTestJSON-1450956313 None] Lock "cinder-86319203-1a34-4b3f-9ff2-1bc00d3a7c09-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:42:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-977614cf-a5ae-4fdb-b1d6-6bf2beb19175 tempest-ServersNegativeTestJSON-1450956313 None] Acquiring lock "cinder-bc00b810-c277-4d28-bbed-441e83ae17aa-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:42:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-977614cf-a5ae-4fdb-b1d6-6bf2beb19175 tempest-ServersNegativeTestJSON-1450956313 None] Lock "cinder-bc00b810-c277-4d28-bbed-441e83ae17aa-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:42:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-977614cf-a5ae-4fdb-b1d6-6bf2beb19175 tempest-ServersNegativeTestJSON-1450956313 None] Acquiring lock "cinder-quobyte-bc00b810-c277-4d28-bbed-441e83ae17aa" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:42:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-977614cf-a5ae-4fdb-b1d6-6bf2beb19175 tempest-ServersNegativeTestJSON-1450956313 None] Lock "cinder-quobyte-bc00b810-c277-4d28-bbed-441e83ae17aa" acquired by "delete_volume" :: waited 0.022s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:42:28 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[082b88b1-e9fd-4ed4-86c9-998932f3603d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:42:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-977614cf-a5ae-4fdb-b1d6-6bf2beb19175 tempest-ServersNegativeTestJSON-1450956313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc00b810-c277-4d28-bbed-441e83ae17aa {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:28 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc00b810-c277-4d28-bbed-441e83ae17aa Nov 05 03:42:28 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:28 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-977614cf-a5ae-4fdb-b1d6-6bf2beb19175 tempest-ServersNegativeTestJSON-1450956313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc00b810-c277-4d28-bbed-441e83ae17aa" returned: 0 in 0.447s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-977614cf-a5ae-4fdb-b1d6-6bf2beb19175 tempest-ServersNegativeTestJSON-1450956313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc00b810-c277-4d28-bbed-441e83ae17aa {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:28 devstack sudo[88540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc00b810-c277-4d28-bbed-441e83ae17aa Nov 05 03:42:28 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:29 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-977614cf-a5ae-4fdb-b1d6-6bf2beb19175 tempest-ServersNegativeTestJSON-1450956313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc00b810-c277-4d28-bbed-441e83ae17aa" returned: 0 in 0.445s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-977614cf-a5ae-4fdb-b1d6-6bf2beb19175 tempest-ServersNegativeTestJSON-1450956313 None] Lock "cinder-quobyte-bc00b810-c277-4d28-bbed-441e83ae17aa" released by "delete_volume" :: held 0.951s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:42:29 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-977614cf-a5ae-4fdb-b1d6-6bf2beb19175 tempest-ServersNegativeTestJSON-1450956313 None] Created reservations ['2bc044b1-6a8a-4e60-8c8e-d4288083e846', '68d56751-d73c-43bf-9245-2315371983e4', '34d9e990-903c-49af-8f77-936052f82688', '3d3143cc-6f50-42ee-9d31-0ca49b8fc645'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:42:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-977614cf-a5ae-4fdb-b1d6-6bf2beb19175 tempest-ServersNegativeTestJSON-1450956313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-977614cf-a5ae-4fdb-b1d6-6bf2beb19175 tempest-ServersNegativeTestJSON-1450956313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-977614cf-a5ae-4fdb-b1d6-6bf2beb19175 tempest-ServersNegativeTestJSON-1450956313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:42:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-977614cf-a5ae-4fdb-b1d6-6bf2beb19175 tempest-ServersNegativeTestJSON-1450956313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:42:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-977614cf-a5ae-4fdb-b1d6-6bf2beb19175 tempest-ServersNegativeTestJSON-1450956313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-977614cf-a5ae-4fdb-b1d6-6bf2beb19175 tempest-ServersNegativeTestJSON-1450956313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:29 devstack sudo[88546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:42:29 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:29 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-977614cf-a5ae-4fdb-b1d6-6bf2beb19175 tempest-ServersNegativeTestJSON-1450956313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.308s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:29 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-977614cf-a5ae-4fdb-b1d6-6bf2beb19175 tempest-ServersNegativeTestJSON-1450956313 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:42:29 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-977614cf-a5ae-4fdb-b1d6-6bf2beb19175 tempest-ServersNegativeTestJSON-1450956313 None] Deleted volume successfully. Nov 05 03:42:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-977614cf-a5ae-4fdb-b1d6-6bf2beb19175 tempest-ServersNegativeTestJSON-1450956313 None] Lock "cinder-bc00b810-c277-4d28-bbed-441e83ae17aa-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:42:38 devstack cinder-volume[87109]: WARNING py.warnings [req-dfec6933-645b-4b58-953c-16f4ae5395ab req-4018be5e-14e8-44c4-9b68-0c3e96719b89 tempest-TaggedAttachmentsTest-1297816677 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Nov 05 03:42:38 devstack cinder-volume[87109]: .first() Nov 05 03:42:38 devstack cinder-volume[87109]: Nov 05 03:42:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-dfec6933-645b-4b58-953c-16f4ae5395ab req-4018be5e-14e8-44c4-9b68-0c3e96719b89 tempest-TaggedAttachmentsTest-1297816677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-dfec6933-645b-4b58-953c-16f4ae5395ab req-4018be5e-14e8-44c4-9b68-0c3e96719b89 tempest-TaggedAttachmentsTest-1297816677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-dfec6933-645b-4b58-953c-16f4ae5395ab req-4018be5e-14e8-44c4-9b68-0c3e96719b89 tempest-TaggedAttachmentsTest-1297816677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-dfec6933-645b-4b58-953c-16f4ae5395ab req-4018be5e-14e8-44c4-9b68-0c3e96719b89 tempest-TaggedAttachmentsTest-1297816677 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-de6a4583-2932-4151-8029-ad928bfcc9ac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9892f577-c3f4-4cbf-94b2-5919c1c87f95', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:42:38 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-dfec6933-645b-4b58-953c-16f4ae5395ab req-4018be5e-14e8-44c4-9b68-0c3e96719b89 tempest-TaggedAttachmentsTest-1297816677 None] attachment_update completed successfully. Nov 05 03:42:44 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-121a6467-3e51-4066-b79b-f61d45b2e9a4 req-cc9dedaf-0c9f-49af-a09f-43d987db66e2 tempest-TaggedAttachmentsTest-1297816677 None] Terminate volume connection completed successfully. Nov 05 03:42:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-121a6467-3e51-4066-b79b-f61d45b2e9a4 req-cc9dedaf-0c9f-49af-a09f-43d987db66e2 tempest-TaggedAttachmentsTest-1297816677 None] Deleting attachment 9892f577-c3f4-4cbf-94b2-5919c1c87f95. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Flow 'volume_create_manager' (54757dc6-de63-4ddd-9f8e-dee7aab4ca47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d108ff02-6df8-4a4e-b6d6-3c34a058955f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d108ff02-6df8-4a4e-b6d6-3c34a058955f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1955673340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a34967f-1e9f-4808-8e3b-3168a23e6753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc7f52a4c204caf87e0e57bab31d3f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:46Z,use_quota=True,user_id='e71e942570f442b488188668a0ef2e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c480c4-b2fb-4a38-9974-fb9054b6960d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5c480c4-b2fb-4a38-9974-fb9054b6960d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad959de-ae6d-4138-901d-3c37d806a498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad959de-ae6d-4138-901d-3c37d806a498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a34967f-1e9f-4808-8e3b-3168a23e6753', 'volume_name': 'volume-1a34967f-1e9f-4808-8e3b-3168a23e6753', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f75313-e5ad-48fc-b1a4-18cf03d74885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3f75313-e5ad-48fc-b1a4-18cf03d74885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1bad4f-2d16-4f88-8079-393e343bdee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:46 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Volume 1a34967f-1e9f-4808-8e3b-3168a23e6753: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a34967f-1e9f-4808-8e3b-3168a23e6753', 'volume_size': 1} Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1955673340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a34967f-1e9f-4808-8e3b-3168a23e6753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efc7f52a4c204caf87e0e57bab31d3f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:46Z,use_quota=True,user_id='e71e942570f442b488188668a0ef2e0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Creating volume 1a34967f-1e9f-4808-8e3b-3168a23e6753 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:42:46 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:42:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1a34967f-1e9f-4808-8e3b-3168a23e6753 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:46 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1a34967f-1e9f-4808-8e3b-3168a23e6753 1073741824 Nov 05 03:42:46 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:46 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1a34967f-1e9f-4808-8e3b-3168a23e6753 1073741824" returned: 0 in 0.796s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1a34967f-1e9f-4808-8e3b-3168a23e6753 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:47 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1a34967f-1e9f-4808-8e3b-3168a23e6753 Nov 05 03:42:47 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:47 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1a34967f-1e9f-4808-8e3b-3168a23e6753" returned: 0 in 0.410s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:42:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1bad4f-2d16-4f88-8079-393e343bdee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a34967f-1e9f-4808-8e3b-3168a23e6753', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0888aef5-21bd-436c-8b8f-32872d68b246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:47 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Volume volume-1a34967f-1e9f-4808-8e3b-3168a23e6753 (1a34967f-1e9f-4808-8e3b-3168a23e6753): created successfully Nov 05 03:42:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0888aef5-21bd-436c-8b8f-32872d68b246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Flow 'volume_create_manager' (54757dc6-de63-4ddd-9f8e-dee7aab4ca47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:42:47 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-9652fa08-20f8-4f40-ad2f-7447e56d6565 tempest-DeleteServersTestJSON-1499495602 None] Created volume successfully. Nov 05 03:42:50 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:UPDATE=41,cinder:SELECT=33,cinder:DELETE=6,cinder:INSERT=7 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:42:50 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=37,cinder:INSERT=9,cinder:UPDATE=35,cinder:DELETE=1 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:42:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-bd5c413b-9d10-4339-96c6-c097d121c26e req-98ef0e6d-a3f0-48a4-8f95-939575f9efd6 tempest-DeleteServersTestJSON-1499495602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-bd5c413b-9d10-4339-96c6-c097d121c26e req-98ef0e6d-a3f0-48a4-8f95-939575f9efd6 tempest-DeleteServersTestJSON-1499495602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-bd5c413b-9d10-4339-96c6-c097d121c26e req-98ef0e6d-a3f0-48a4-8f95-939575f9efd6 tempest-DeleteServersTestJSON-1499495602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-bd5c413b-9d10-4339-96c6-c097d121c26e req-98ef0e6d-a3f0-48a4-8f95-939575f9efd6 tempest-DeleteServersTestJSON-1499495602 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-1a34967f-1e9f-4808-8e3b-3168a23e6753', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f56a5cec-e55b-4163-b41d-1dd1f93f7ec0', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:42:51 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-bd5c413b-9d10-4339-96c6-c097d121c26e req-98ef0e6d-a3f0-48a4-8f95-939575f9efd6 tempest-DeleteServersTestJSON-1499495602 None] attachment_update completed successfully. Nov 05 03:42:53 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b2a2c94e-b219-4948-a373-626c9d0f0980 tempest-GroupSnapshotsV319Test-1098703739 None] Group tempest-GroupSnapshotsV319Test-Group-1281800878: creating Nov 05 03:42:53 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b2a2c94e-b219-4948-a373-626c9d0f0980 tempest-GroupSnapshotsV319Test-1098703739 None] Group tempest-GroupSnapshotsV319Test-Group-1281800878: created successfully Nov 05 03:42:53 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b2a2c94e-b219-4948-a373-626c9d0f0980 tempest-GroupSnapshotsV319Test-1098703739 None] Create group completed successfully. Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Flow 'volume_create_manager' (a37eeb4b-14ee-4006-9877-675fe4718ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d478926-d87b-4502-bb99-dfaaf1d0de95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d478926-d87b-4502-bb99-dfaaf1d0de95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-56976077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49ff2c51-e8e4-4b6f-9a00-5e7c7d5bc518,host='devstack@QuobyteHD#QuobyteHD',id=ae42a162-87b3-46ec-a1a1-4ce0d5923758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59868f27da334ceb868a7ba1681eb839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:56Z,use_quota=True,user_id='117296e12baf4fccbdcbf5cfd4ca5473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6773603-d640-43a8-a70d-0d2b8774e3e7),volume_type_id=e6773603-d640-43a8-a70d-0d2b8774e3e7)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4ae5dc-a220-4dd3-8175-80fce5773f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4ae5dc-a220-4dd3-8175-80fce5773f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04ee95a-0ed8-4d0a-ae03-d3d7438ae322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b04ee95a-0ed8-4d0a-ae03-d3d7438ae322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae42a162-87b3-46ec-a1a1-4ce0d5923758', 'volume_name': 'volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a18d50-0f46-4947-8c10-7c154e2608bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a18d50-0f46-4947-8c10-7c154e2608bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1961f907-eff0-4a90-aa98-fab53b04d5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:55 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Volume ae42a162-87b3-46ec-a1a1-4ce0d5923758: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758', 'volume_size': 1} Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=49ff2c51-e8e4-4b6f-9a00-5e7c7d5bc518,created_at=2026-11-05T02:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-56976077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49ff2c51-e8e4-4b6f-9a00-5e7c7d5bc518,host='devstack@QuobyteHD#QuobyteHD',id=ae42a162-87b3-46ec-a1a1-4ce0d5923758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59868f27da334ceb868a7ba1681eb839',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:42:56Z,use_quota=True,user_id='117296e12baf4fccbdcbf5cfd4ca5473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6773603-d640-43a8-a70d-0d2b8774e3e7),volume_type_id=e6773603-d640-43a8-a70d-0d2b8774e3e7)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Creating volume ae42a162-87b3-46ec-a1a1-4ce0d5923758 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:42:55 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:42:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:55 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758 1073741824 Nov 05 03:42:55 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:56 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758 1073741824" returned: 0 in 0.572s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:56 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758 Nov 05 03:42:56 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:56 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758" returned: 0 in 0.411s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:42:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1961f907-eff0-4a90-aa98-fab53b04d5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09498e4b-72d3-4518-9850-031f33a49a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:42:57 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-e8adfb85-b2ae-43d0-8e1a-3bf9c5be098f req-ab2a7397-0d36-4cfe-9934-943c411300f4 tempest-DeleteServersTestJSON-1499495602 None] Terminate volume connection completed successfully. Nov 05 03:42:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-e8adfb85-b2ae-43d0-8e1a-3bf9c5be098f req-ab2a7397-0d36-4cfe-9934-943c411300f4 tempest-DeleteServersTestJSON-1499495602 None] Deleting attachment f56a5cec-e55b-4163-b41d-1dd1f93f7ec0. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:42:57 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Volume volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758 (ae42a162-87b3-46ec-a1a1-4ce0d5923758): created successfully Nov 05 03:42:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09498e4b-72d3-4518-9850-031f33a49a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:42:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Flow 'volume_create_manager' (a37eeb4b-14ee-4006-9877-675fe4718ad2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:42:57 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-256e4cf8-d2d2-40ee-b027-79aa4d81f51c tempest-GroupSnapshotsV319Test-1098703739 None] Created volume successfully. Nov 05 03:42:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:42:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:42:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:42:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:42:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:58 devstack sudo[89749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:42:58 devstack sudo[89749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:58 devstack sudo[89749]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.430s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:58 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:42:58 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-9f436d68-1bf0-4c65-a4c4-a38bfd2b67a2 tempest-GroupSnapshotsV319Test-1098703739 None] GroupSnapshot 0ae17598-d8e9-45fc-8bfd-37f824fc6b65: creating. Nov 05 03:42:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9f436d68-1bf0-4c65-a4c4-a38bfd2b67a2 tempest-GroupSnapshotsV319Test-1098703739 None] Group snapshot 0ae17598-d8e9-45fc-8bfd-37f824fc6b65: creating. {{(pid=87109) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4196}} Nov 05 03:42:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9f436d68-1bf0-4c65-a4c4-a38bfd2b67a2 tempest-GroupSnapshotsV319Test-1098703739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:42:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9f436d68-1bf0-4c65-a4c4-a38bfd2b67a2 tempest-GroupSnapshotsV319Test-1098703739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:42:59 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-9f436d68-1bf0-4c65-a4c4-a38bfd2b67a2 tempest-GroupSnapshotsV319Test-1098703739 None] Creating offline snapshot cd390199-ccda-4414-b767-2cf91c8426c0 of volume ae42a162-87b3-46ec-a1a1-4ce0d5923758 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:42:59 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1792c70d-c904-44f9-ab90-e8911048b963]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:42:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f436d68-1bf0-4c65-a4c4-a38bfd2b67a2 tempest-GroupSnapshotsV319Test-1098703739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:59 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758 Nov 05 03:42:59 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8927934f-40ea-4e11-86ce-3e9b82f88d88 tempest-DeleteServersTestJSON-1499495602 None] Acquiring lock "cinder-1a34967f-1e9f-4808-8e3b-3168a23e6753-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:42:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8927934f-40ea-4e11-86ce-3e9b82f88d88 tempest-DeleteServersTestJSON-1499495602 None] Lock "cinder-1a34967f-1e9f-4808-8e3b-3168a23e6753-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:42:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8927934f-40ea-4e11-86ce-3e9b82f88d88 tempest-DeleteServersTestJSON-1499495602 None] Acquiring lock "cinder-quobyte-1a34967f-1e9f-4808-8e3b-3168a23e6753" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:42:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8927934f-40ea-4e11-86ce-3e9b82f88d88 tempest-DeleteServersTestJSON-1499495602 None] Lock "cinder-quobyte-1a34967f-1e9f-4808-8e3b-3168a23e6753" acquired by "delete_volume" :: waited 0.049s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:42:59 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[715137b4-745b-42d5-bef2-2009c528958c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:42:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8927934f-40ea-4e11-86ce-3e9b82f88d88 tempest-DeleteServersTestJSON-1499495602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1a34967f-1e9f-4808-8e3b-3168a23e6753 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:59 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1a34967f-1e9f-4808-8e3b-3168a23e6753 Nov 05 03:42:59 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:42:59 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Nov 05 03:42:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f436d68-1bf0-4c65-a4c4-a38bfd2b67a2 tempest-GroupSnapshotsV319Test-1098703739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758" returned: 0 in 0.744s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:42:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f436d68-1bf0-4c65-a4c4-a38bfd2b67a2 tempest-GroupSnapshotsV319Test-1098703739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.cd390199-ccda-4414-b767-2cf91c8426c0 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:42:59 devstack sudo[89798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.cd390199-ccda-4414-b767-2cf91c8426c0 1G Nov 05 03:42:59 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:00 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8927934f-40ea-4e11-86ce-3e9b82f88d88 tempest-DeleteServersTestJSON-1499495602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1a34967f-1e9f-4808-8e3b-3168a23e6753" returned: 0 in 0.468s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8927934f-40ea-4e11-86ce-3e9b82f88d88 tempest-DeleteServersTestJSON-1499495602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1a34967f-1e9f-4808-8e3b-3168a23e6753 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:00 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1a34967f-1e9f-4808-8e3b-3168a23e6753 Nov 05 03:43:00 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:00 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f436d68-1bf0-4c65-a4c4-a38bfd2b67a2 tempest-GroupSnapshotsV319Test-1098703739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.cd390199-ccda-4414-b767-2cf91c8426c0 1G" returned: 0 in 0.428s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f436d68-1bf0-4c65-a4c4-a38bfd2b67a2 tempest-GroupSnapshotsV319Test-1098703739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.cd390199-ccda-4414-b767-2cf91c8426c0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:00 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.cd390199-ccda-4414-b767-2cf91c8426c0 Nov 05 03:43:00 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:00 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8927934f-40ea-4e11-86ce-3e9b82f88d88 tempest-DeleteServersTestJSON-1499495602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1a34967f-1e9f-4808-8e3b-3168a23e6753" returned: 0 in 0.269s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8927934f-40ea-4e11-86ce-3e9b82f88d88 tempest-DeleteServersTestJSON-1499495602 None] Lock "cinder-quobyte-1a34967f-1e9f-4808-8e3b-3168a23e6753" released by "delete_volume" :: held 0.818s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:43:00 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f436d68-1bf0-4c65-a4c4-a38bfd2b67a2 tempest-GroupSnapshotsV319Test-1098703739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.cd390199-ccda-4414-b767-2cf91c8426c0" returned: 0 in 0.380s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:00 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-9f436d68-1bf0-4c65-a4c4-a38bfd2b67a2 tempest-GroupSnapshotsV319Test-1098703739 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.cd390199-ccda-4414-b767-2cf91c8426c0 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:43:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f436d68-1bf0-4c65-a4c4-a38bfd2b67a2 tempest-GroupSnapshotsV319Test-1098703739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.cd390199-ccda-4414-b767-2cf91c8426c0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:00 devstack sudo[89815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.cd390199-ccda-4414-b767-2cf91c8426c0 Nov 05 03:43:00 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:00 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f436d68-1bf0-4c65-a4c4-a38bfd2b67a2 tempest-GroupSnapshotsV319Test-1098703739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.cd390199-ccda-4414-b767-2cf91c8426c0" returned: 0 in 0.249s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:01 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-8927934f-40ea-4e11-86ce-3e9b82f88d88 tempest-DeleteServersTestJSON-1499495602 None] Created reservations ['a2cbfa54-ee9b-457c-82cd-d4555fba6592', '2cb821f6-77a1-4396-83eb-fb90c9052960', '364aef1c-6a50-4235-bab3-4a3ebc88e25e', '36e2d832-6eaf-47cc-aa92-ac98e3360c09'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:43:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2858e56d-09af-4d29-9ca3-c0520ee7cb06 tempest-TaggedAttachmentsTest-1297816677 None] Acquiring lock "cinder-de6a4583-2932-4151-8029-ad928bfcc9ac-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:43:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2858e56d-09af-4d29-9ca3-c0520ee7cb06 tempest-TaggedAttachmentsTest-1297816677 None] Lock "cinder-de6a4583-2932-4151-8029-ad928bfcc9ac-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:43:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f436d68-1bf0-4c65-a4c4-a38bfd2b67a2 tempest-GroupSnapshotsV319Test-1098703739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:02 devstack sudo[89819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.info Nov 05 03:43:02 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:02 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2858e56d-09af-4d29-9ca3-c0520ee7cb06 tempest-TaggedAttachmentsTest-1297816677 None] Acquiring lock "cinder-quobyte-de6a4583-2932-4151-8029-ad928bfcc9ac" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:43:02 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2858e56d-09af-4d29-9ca3-c0520ee7cb06 tempest-TaggedAttachmentsTest-1297816677 None] Lock "cinder-quobyte-de6a4583-2932-4151-8029-ad928bfcc9ac" acquired by "delete_volume" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:43:02 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e735dac4-058a-4eef-9cd5-e553c09a0cbb]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:43:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2858e56d-09af-4d29-9ca3-c0520ee7cb06 tempest-TaggedAttachmentsTest-1297816677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-de6a4583-2932-4151-8029-ad928bfcc9ac {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:02 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-de6a4583-2932-4151-8029-ad928bfcc9ac Nov 05 03:43:02 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:03 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f436d68-1bf0-4c65-a4c4-a38bfd2b67a2 tempest-GroupSnapshotsV319Test-1098703739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.info" returned: 0 in 0.261s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:03 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-9f436d68-1bf0-4c65-a4c4-a38bfd2b67a2 tempest-GroupSnapshotsV319Test-1098703739 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:43:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f436d68-1bf0-4c65-a4c4-a38bfd2b67a2 tempest-GroupSnapshotsV319Test-1098703739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:03 devstack sudo[89824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.info Nov 05 03:43:03 devstack sudo[89824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:03 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2858e56d-09af-4d29-9ca3-c0520ee7cb06 tempest-TaggedAttachmentsTest-1297816677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-de6a4583-2932-4151-8029-ad928bfcc9ac" returned: 0 in 0.349s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2858e56d-09af-4d29-9ca3-c0520ee7cb06 tempest-TaggedAttachmentsTest-1297816677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-de6a4583-2932-4151-8029-ad928bfcc9ac {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:03 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-de6a4583-2932-4151-8029-ad928bfcc9ac Nov 05 03:43:03 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:03 devstack sudo[89824]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f436d68-1bf0-4c65-a4c4-a38bfd2b67a2 tempest-GroupSnapshotsV319Test-1098703739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.info" returned: 0 in 0.236s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9f436d68-1bf0-4c65-a4c4-a38bfd2b67a2 tempest-GroupSnapshotsV319Test-1098703739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.225s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:03 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2858e56d-09af-4d29-9ca3-c0520ee7cb06 tempest-TaggedAttachmentsTest-1297816677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-de6a4583-2932-4151-8029-ad928bfcc9ac" returned: 0 in 0.231s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:03 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2858e56d-09af-4d29-9ca3-c0520ee7cb06 tempest-TaggedAttachmentsTest-1297816677 None] Lock "cinder-quobyte-de6a4583-2932-4151-8029-ad928bfcc9ac" released by "delete_volume" :: held 0.617s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:43:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8927934f-40ea-4e11-86ce-3e9b82f88d88 tempest-DeleteServersTestJSON-1499495602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8927934f-40ea-4e11-86ce-3e9b82f88d88 tempest-DeleteServersTestJSON-1499495602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8927934f-40ea-4e11-86ce-3e9b82f88d88 tempest-DeleteServersTestJSON-1499495602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:43:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8927934f-40ea-4e11-86ce-3e9b82f88d88 tempest-DeleteServersTestJSON-1499495602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:43:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8927934f-40ea-4e11-86ce-3e9b82f88d88 tempest-DeleteServersTestJSON-1499495602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8927934f-40ea-4e11-86ce-3e9b82f88d88 tempest-DeleteServersTestJSON-1499495602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:04 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:43:04 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:04 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-2858e56d-09af-4d29-9ca3-c0520ee7cb06 tempest-TaggedAttachmentsTest-1297816677 None] Created reservations ['3bc36e27-f8d8-4b01-a69e-636ef1ffb0e8', '74307c25-af4e-4f02-b145-4489ebb2a2be', 'fb982f75-b767-4dc9-a36a-bada72741e2f', '5be7b965-ca0b-41cf-99c5-79bc0ace97e3'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:43:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2858e56d-09af-4d29-9ca3-c0520ee7cb06 tempest-TaggedAttachmentsTest-1297816677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2858e56d-09af-4d29-9ca3-c0520ee7cb06 tempest-TaggedAttachmentsTest-1297816677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2858e56d-09af-4d29-9ca3-c0520ee7cb06 tempest-TaggedAttachmentsTest-1297816677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:43:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2858e56d-09af-4d29-9ca3-c0520ee7cb06 tempest-TaggedAttachmentsTest-1297816677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:43:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2858e56d-09af-4d29-9ca3-c0520ee7cb06 tempest-TaggedAttachmentsTest-1297816677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2858e56d-09af-4d29-9ca3-c0520ee7cb06 tempest-TaggedAttachmentsTest-1297816677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:04 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-9f436d68-1bf0-4c65-a4c4-a38bfd2b67a2 tempest-GroupSnapshotsV319Test-1098703739 None] group_snapshot 0ae17598-d8e9-45fc-8bfd-37f824fc6b65: created successfully Nov 05 03:43:04 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:43:04 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:04 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8927934f-40ea-4e11-86ce-3e9b82f88d88 tempest-DeleteServersTestJSON-1499495602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.421s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:04 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-8927934f-40ea-4e11-86ce-3e9b82f88d88 tempest-DeleteServersTestJSON-1499495602 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:43:05 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-8927934f-40ea-4e11-86ce-3e9b82f88d88 tempest-DeleteServersTestJSON-1499495602 None] Deleted volume successfully. Nov 05 03:43:05 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8927934f-40ea-4e11-86ce-3e9b82f88d88 tempest-DeleteServersTestJSON-1499495602 None] Lock "cinder-1a34967f-1e9f-4808-8e3b-3168a23e6753-delete_volume" released by "delete_volume" :: held 5.557s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:43:05 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2858e56d-09af-4d29-9ca3-c0520ee7cb06 tempest-TaggedAttachmentsTest-1297816677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.333s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:05 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-2858e56d-09af-4d29-9ca3-c0520ee7cb06 tempest-TaggedAttachmentsTest-1297816677 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:43:05 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-2858e56d-09af-4d29-9ca3-c0520ee7cb06 tempest-TaggedAttachmentsTest-1297816677 None] Deleted volume successfully. Nov 05 03:43:05 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2858e56d-09af-4d29-9ca3-c0520ee7cb06 tempest-TaggedAttachmentsTest-1297816677 None] Lock "cinder-de6a4583-2932-4151-8029-ad928bfcc9ac-delete_volume" released by "delete_volume" :: held 3.929s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:43:06 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] group_snapshot 0ae17598-d8e9-45fc-8bfd-37f824fc6b65: deleting Nov 05 03:43:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] group_snapshot 0ae17598-d8e9-45fc-8bfd-37f824fc6b65: deleting {{(pid=87109) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4371}} Nov 05 03:43:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] Acquiring lock "cinder-quobyte-ae42a162-87b3-46ec-a1a1-4ce0d5923758" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:43:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] Lock "cinder-quobyte-ae42a162-87b3-46ec-a1a1-4ce0d5923758" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:43:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] Acquiring lock "cinder-quobyte-cd390199-ccda-4414-b767-2cf91c8426c0" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:43:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] Lock "cinder-quobyte-cd390199-ccda-4414-b767-2cf91c8426c0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:43:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] Deleting offline snapshot cd390199-ccda-4414-b767-2cf91c8426c0 of volume ae42a162-87b3-46ec-a1a1-4ce0d5923758 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:43:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] snapshot_file for this snap is: volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.cd390199-ccda-4414-b767-2cf91c8426c0 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:43:06 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62c0da7-7e1c-4373-bea2-d04c793ffd02]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:43:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.cd390199-ccda-4414-b767-2cf91c8426c0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:06 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.cd390199-ccda-4414-b767-2cf91c8426c0 Nov 05 03:43:06 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:06 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.cd390199-ccda-4414-b767-2cf91c8426c0" returned: 0 in 0.494s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:43:06 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb73614-cf43-47ae-9ed5-6e7f2de7cb4a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:43:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:06 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758 Nov 05 03:43:06 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:07 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758" returned: 0 in 0.417s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.cd390199-ccda-4414-b767-2cf91c8426c0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:07 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.cd390199-ccda-4414-b767-2cf91c8426c0 Nov 05 03:43:07 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:07 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.cd390199-ccda-4414-b767-2cf91c8426c0" returned: 0 in 0.455s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.cd390199-ccda-4414-b767-2cf91c8426c0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:07 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.cd390199-ccda-4414-b767-2cf91c8426c0 Nov 05 03:43:07 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:08 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758.cd390199-ccda-4414-b767-2cf91c8426c0" returned: 0 in 0.278s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] Lock "cinder-quobyte-cd390199-ccda-4414-b767-2cf91c8426c0" released by "_delete_snapshot" :: held 1.768s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:43:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] Lock "cinder-quobyte-ae42a162-87b3-46ec-a1a1-4ce0d5923758" released by "delete_snapshot" :: held 1.800s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:43:08 devstack cinder-volume[87109]: WARNING cinder.quota [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1614416719 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1614416719, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:43:08 devstack cinder-volume[87109]: WARNING cinder.quota [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1614416719 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1614416719, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:43:08 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] Created reservations ['f77ea131-f82b-443b-919d-545c36169327', 'a53530a0-955a-4462-9b59-e69006a2fcd4', '9f77e537-1c7c-4a43-8792-009ba3421d18', 'db52e739-1851-4c4c-988c-d7c912b46760'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:43:08 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-49964564-0dc8-4689-a105-e657991393c6 tempest-GroupSnapshotsV319Test-1098703739 None] group_snapshot 0ae17598-d8e9-45fc-8bfd-37f824fc6b65: deleted successfully Nov 05 03:43:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cf278f83-4c33-4e6e-b4aa-0e8cf7321a66 tempest-GroupSnapshotsV319Test-1098703739 None] Acquiring lock "cinder-quobyte-ae42a162-87b3-46ec-a1a1-4ce0d5923758" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:43:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cf278f83-4c33-4e6e-b4aa-0e8cf7321a66 tempest-GroupSnapshotsV319Test-1098703739 None] Lock "cinder-quobyte-ae42a162-87b3-46ec-a1a1-4ce0d5923758" acquired by "delete_volume" :: waited 0.035s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:43:09 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8945aa1-3772-4b74-b138-c321b88c2b71]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:43:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cf278f83-4c33-4e6e-b4aa-0e8cf7321a66 tempest-GroupSnapshotsV319Test-1098703739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:09 devstack sudo[89870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758 Nov 05 03:43:09 devstack sudo[89870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:09 devstack sudo[89870]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cf278f83-4c33-4e6e-b4aa-0e8cf7321a66 tempest-GroupSnapshotsV319Test-1098703739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758" returned: 0 in 0.376s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cf278f83-4c33-4e6e-b4aa-0e8cf7321a66 tempest-GroupSnapshotsV319Test-1098703739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:09 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758 Nov 05 03:43:09 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:09 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cf278f83-4c33-4e6e-b4aa-0e8cf7321a66 tempest-GroupSnapshotsV319Test-1098703739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ae42a162-87b3-46ec-a1a1-4ce0d5923758" returned: 0 in 0.234s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cf278f83-4c33-4e6e-b4aa-0e8cf7321a66 tempest-GroupSnapshotsV319Test-1098703739 None] Lock "cinder-quobyte-ae42a162-87b3-46ec-a1a1-4ce0d5923758" released by "delete_volume" :: held 0.725s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:43:09 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-cf278f83-4c33-4e6e-b4aa-0e8cf7321a66 tempest-GroupSnapshotsV319Test-1098703739 None] Created reservations ['1e62d0fd-f688-41e1-a196-c0b42d7ac50f'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:43:09 devstack cinder-volume[87109]: WARNING cinder.quota [None req-cf278f83-4c33-4e6e-b4aa-0e8cf7321a66 tempest-GroupSnapshotsV319Test-1098703739 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1614416719 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1614416719, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:43:09 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-cf278f83-4c33-4e6e-b4aa-0e8cf7321a66 tempest-GroupSnapshotsV319Test-1098703739 None] Created reservations ['347d72be-84d2-452a-b843-9cc02daa4670', '52c807cc-72e2-4e12-b527-5256a35a0278', 'ca22b794-8f41-478f-a966-f86a8aed92f2', 'ec017eef-a9f2-4967-b5f8-03c18d2efc73'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:43:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-cf278f83-4c33-4e6e-b4aa-0e8cf7321a66 tempest-GroupSnapshotsV319Test-1098703739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-cf278f83-4c33-4e6e-b4aa-0e8cf7321a66 tempest-GroupSnapshotsV319Test-1098703739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-cf278f83-4c33-4e6e-b4aa-0e8cf7321a66 tempest-GroupSnapshotsV319Test-1098703739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:43:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-cf278f83-4c33-4e6e-b4aa-0e8cf7321a66 tempest-GroupSnapshotsV319Test-1098703739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:43:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-cf278f83-4c33-4e6e-b4aa-0e8cf7321a66 tempest-GroupSnapshotsV319Test-1098703739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cf278f83-4c33-4e6e-b4aa-0e8cf7321a66 tempest-GroupSnapshotsV319Test-1098703739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:10 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:43:10 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:10 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cf278f83-4c33-4e6e-b4aa-0e8cf7321a66 tempest-GroupSnapshotsV319Test-1098703739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.418s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:10 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-cf278f83-4c33-4e6e-b4aa-0e8cf7321a66 tempest-GroupSnapshotsV319Test-1098703739 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:43:10 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-cf278f83-4c33-4e6e-b4aa-0e8cf7321a66 tempest-GroupSnapshotsV319Test-1098703739 None] Delete group completed successfully. Nov 05 03:43:20 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=44,cinder:UPDATE=46,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:43:20 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=44,cinder:UPDATE=35,cinder:INSERT=11 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:43:52 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-bf30d9ec-0430-427e-bedd-937ee0db370f tempest-GroupsV314Test-2112661973 None] Group tempest-GroupsV314Test-Group-105396049: creating Nov 05 03:43:52 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-bf30d9ec-0430-427e-bedd-937ee0db370f tempest-GroupsV314Test-2112661973 None] Group tempest-GroupsV314Test-Group-105396049: created successfully Nov 05 03:43:52 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-bf30d9ec-0430-427e-bedd-937ee0db370f tempest-GroupsV314Test-2112661973 None] Create group completed successfully. Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Flow 'volume_create_manager' (460aaf73-5f34-48c8-864b-40bd76bb5dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38dacb4-4c1c-42d3-a737-2c29f810ffd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38dacb4-4c1c-42d3-a737-2c29f810ffd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-764940709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b9e3c53-1380-4334-94b6-1f2422a9cc1c,host='devstack@QuobyteHD#QuobyteHD',id=e87a4ad1-a9b5-440a-bf0c-ede586b28764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923acb51164141548f75414f17f3eab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:55Z,use_quota=True,user_id='ff944fcea8634069a85ce73c749d50ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c22d69c-5434-41ed-b3cf-f9b63272b0c1),volume_type_id=6c22d69c-5434-41ed-b3cf-f9b63272b0c1)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7aabdf-1530-41c2-8659-52b6b78ba125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7aabdf-1530-41c2-8659-52b6b78ba125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb78cff9-0130-4d21-95f9-4aa7585cf0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb78cff9-0130-4d21-95f9-4aa7585cf0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e87a4ad1-a9b5-440a-bf0c-ede586b28764', 'volume_name': 'volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d60cd6-18db-4ec5-8347-bb5cec84cb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d60cd6-18db-4ec5-8347-bb5cec84cb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a383e5-bfb7-4e92-a40f-0acb2b1a000f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:55 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Volume e87a4ad1-a9b5-440a-bf0c-ede586b28764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764', 'volume_size': 1} Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7b9e3c53-1380-4334-94b6-1f2422a9cc1c,created_at=2026-11-05T02:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-764940709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b9e3c53-1380-4334-94b6-1f2422a9cc1c,host='devstack@QuobyteHD#QuobyteHD',id=e87a4ad1-a9b5-440a-bf0c-ede586b28764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923acb51164141548f75414f17f3eab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:55Z,use_quota=True,user_id='ff944fcea8634069a85ce73c749d50ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c22d69c-5434-41ed-b3cf-f9b63272b0c1),volume_type_id=6c22d69c-5434-41ed-b3cf-f9b63272b0c1)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Creating volume e87a4ad1-a9b5-440a-bf0c-ede586b28764 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:43:55 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:43:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:55 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 1073741824 Nov 05 03:43:55 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:57 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 1073741824" returned: 0 in 1.494s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:57 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:43:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Flow 'volume_create_manager' (f7e29458-44ee-4bda-b969-66c99f9f62c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:43:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec298be-8381-480d-88d2-4029adf74850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec298be-8381-480d-88d2-4029adf74850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1697454352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6dbdbe2edb643fb94315774309f8c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:57Z,use_quota=True,user_id='3c413b5b5ab34818bb3d4454e0eabcb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58694554-5800-4680-bcef-9378afb002c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58694554-5800-4680-bcef-9378afb002c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:57 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 Nov 05 03:43:57 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12f8236-55ff-4cd4-8801-51dc3227dc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12f8236-55ff-4cd4-8801-51dc3227dc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9', 'volume_name': 'volume-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f883ae8a-7cb9-4dce-8b7b-4a5cd4d3ebc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f883ae8a-7cb9-4dce-8b7b-4a5cd4d3ebc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (051e18fa-dc85-4342-8aca-5e26f709bf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:57 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Volume ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9', 'volume_size': 1} Nov 05 03:43:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:58 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764" returned: 0 in 0.619s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] <== create_volume: return (2506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.509s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.464s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:43:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1697454352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6dbdbe2edb643fb94315774309f8c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:43:57Z,use_quota=True,user_id='3c413b5b5ab34818bb3d4454e0eabcb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Creating volume ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:43:58 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:58 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9 1073741824 Nov 05 03:43:58 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a383e5-bfb7-4e92-a40f-0acb2b1a000f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5001105a-34bd-4939-aaf0-7d07d470d3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:58 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Volume volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 (e87a4ad1-a9b5-440a-bf0c-ede586b28764): created successfully Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5001105a-34bd-4939-aaf0-7d07d470d3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Flow 'volume_create_manager' (460aaf73-5f34-48c8-864b-40bd76bb5dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:43:58 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-4bd4c44d-001c-4357-b868-9a0ed8e3a428 tempest-GroupsV314Test-2112661973 None] Created volume successfully. Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:58 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:43:58 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:59 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9 1073741824" returned: 0 in 0.976s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:59 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.684s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:59 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:43:59 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:43:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 8 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:43:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:43:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:43:59 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9 Nov 05 03:43:59 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:43:59 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Nov 05 03:43:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9" returned: 0 in 0.558s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:43:59 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:43:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:43:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (051e18fa-dc85-4342-8aca-5e26f709bf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055c7fb5-6a74-4182-b98e-b1ca7ee5cd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:43:59 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Volume volume-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9 (ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9): created successfully Nov 05 03:43:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055c7fb5-6a74-4182-b98e-b1ca7ee5cd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:43:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Flow 'volume_create_manager' (f7e29458-44ee-4bda-b969-66c99f9f62c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:43:59 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-aa13ef55-1cb2-4fdd-b24e-f87d5280f8f5 tempest-ServerActionsTestOtherA-151106859 None] Created volume successfully. Nov 05 03:44:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:00 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Cloning volume e87a4ad1-a9b5-440a-bf0c-ede586b28764 to volume d3cf3876-cc49-404f-a796-dbc318c7e25a Nov 05 03:44:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Creating offline snapshot 3151ef55-deb0-40e0-baf0-8d0eac30990f of volume e87a4ad1-a9b5-440a-bf0c-ede586b28764 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:44:00 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dd7b11-ca79-405e-91d2-740105f653e0]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:44:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:00 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 Nov 05 03:44:00 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:01 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764" returned: 0 in 0.523s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:01 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f 1G Nov 05 03:44:01 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:02 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f 1G" returned: 0 in 0.803s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:02 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f Nov 05 03:44:02 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:02 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f" returned: 0 in 0.724s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:02 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:44:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:02 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f Nov 05 03:44:02 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:03 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f" returned: 0 in 0.519s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:03 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.info Nov 05 03:44:03 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:03 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.info" returned: 0 in 0.529s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:03 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:44:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:04 devstack sudo[90383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.info Nov 05 03:44:04 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:04 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.info" returned: 0 in 0.680s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:04 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Acquiring lock "cinder-quobyte-d3cf3876-cc49-404f-a796-dbc318c7e25a" by "_copy_volume_from_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:04 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Lock "cinder-quobyte-d3cf3876-cc49-404f-a796-dbc318c7e25a" acquired by "_copy_volume_from_snapshot" :: waited 0.059s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] snapshot: 3151ef55-deb0-40e0-baf0-8d0eac30990f, volume: d3cf3876-cc49-404f-a796-dbc318c7e25a, {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 03:44:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:44:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:44:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:04 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77fddf0-e82c-403c-9b50-de79f0f59cc5]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:44:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:05 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f Nov 05 03:44:05 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:05 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f" returned: 0 in 0.744s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:44:05 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[650e9b9d-ce28-4cc6-a3f3-6e3cb2657d7a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:44:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:05 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 Nov 05 03:44:05 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:06 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764" returned: 0 in 0.970s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 03:44:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Creating direct copy from snapshot {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 03:44:06 devstack cinder-volume[87109]: DEBUG cinder.utils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Path /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d3cf3876-cc49-404f-a796-dbc318c7e25a not found in is_blk_device check {{(pid=87109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 03:44:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d3cf3876-cc49-404f-a796-dbc318c7e25a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:06 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d3cf3876-cc49-404f-a796-dbc318c7e25a Nov 05 03:44:06 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:10 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:44:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Flow 'volume_create_manager' (2045d1fe-f23b-4b8e-ab13-3bfbf5119c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:44:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8278ba97-fbdd-4bf9-8cc1-bcdeb3c8b831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8278ba97-fbdd-4bf9-8cc1-bcdeb3c8b831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-485503214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c997db4e-4a40-4af2-9cbb-7b37c859e252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e835d93c5fab43489fa4cc00d21a816d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:11Z,use_quota=True,user_id='77c33726337e4b91b3803806bb3104c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3830355-cb6f-4c1e-9937-c57fe1b48cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3830355-cb6f-4c1e-9937-c57fe1b48cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d516355a-9086-4106-8f97-a9f230865c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d516355a-9086-4106-8f97-a9f230865c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c997db4e-4a40-4af2-9cbb-7b37c859e252', 'volume_name': 'volume-c997db4e-4a40-4af2-9cbb-7b37c859e252', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2608e1a-90ae-40e9-86bf-fbf40f889981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2608e1a-90ae-40e9-86bf-fbf40f889981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d96846-6a9f-48df-879b-4f621896f698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:11 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Volume c997db4e-4a40-4af2-9cbb-7b37c859e252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c997db4e-4a40-4af2-9cbb-7b37c859e252', 'volume_size': 1} Nov 05 03:44:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:13 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:UPDATE=8,cinder:SELECT=10,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:44:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d3cf3876-cc49-404f-a796-dbc318c7e25a" returned: 0 in 15.707s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:22 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Image conversion details: src /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764, size 1024.00 MB, duration 15.71 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d3cf3876-cc49-404f-a796-dbc318c7e25a {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:44:22 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Converted 1024.00 MB image at 65.19 MB/s Nov 05 03:44:22 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d3cf3876-cc49-404f-a796-dbc318c7e25a is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:44:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d3cf3876-cc49-404f-a796-dbc318c7e25a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:22 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d3cf3876-cc49-404f-a796-dbc318c7e25a Nov 05 03:44:22 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:22 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d3cf3876-cc49-404f-a796-dbc318c7e25a" returned: 0 in 0.294s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Lock "cinder-quobyte-d3cf3876-cc49-404f-a796-dbc318c7e25a" released by "_copy_volume_from_snapshot" :: held 17.936s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:44:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Acquiring lock "cinder-quobyte-3151ef55-deb0-40e0-baf0-8d0eac30990f" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Lock "cinder-quobyte-3151ef55-deb0-40e0-baf0-8d0eac30990f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Deleting offline snapshot 3151ef55-deb0-40e0-baf0-8d0eac30990f of volume e87a4ad1-a9b5-440a-bf0c-ede586b28764 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:44:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] snapshot_file for this snap is: volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:44:22 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[843433bd-8282-41c6-ba9f-c2f275df1e7a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:44:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:22 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f Nov 05 03:44:22 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:23 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f" returned: 0 in 0.600s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:44:23 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ceb697-5c23-478c-8563-c59e901a170c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:44:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:23 devstack sudo[90641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 Nov 05 03:44:23 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:24 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764" returned: 0 in 0.674s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:24 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f Nov 05 03:44:24 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:24 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f" returned: 0 in 0.432s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:24 devstack sudo[90656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f Nov 05 03:44:24 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:24 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764.3151ef55-deb0-40e0-baf0-8d0eac30990f" returned: 0 in 0.302s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Lock "cinder-quobyte-3151ef55-deb0-40e0-baf0-8d0eac30990f" released by "_delete_snapshot" :: held 2.157s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:44:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 24.235s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.561s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:24 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-485503214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c997db4e-4a40-4af2-9cbb-7b37c859e252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e835d93c5fab43489fa4cc00d21a816d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:11Z,use_quota=True,user_id='77c33726337e4b91b3803806bb3104c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:44:24 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Creating volume c997db4e-4a40-4af2-9cbb-7b37c859e252 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:44:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:24 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:44:24 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:44:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:24 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:44:24 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:44:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c997db4e-4a40-4af2-9cbb-7b37c859e252 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:24 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c997db4e-4a40-4af2-9cbb-7b37c859e252 1073741824 Nov 05 03:44:24 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:25 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-1fbace40-d559-4009-898f-6cb811ad03c6 tempest-GroupsV314Test-2112661973 None] Create group from source-group-7b9e3c53-1380-4334-94b6-1f2422a9cc1c completed successfully. Nov 05 03:44:25 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c997db4e-4a40-4af2-9cbb-7b37c859e252 1073741824" returned: 0 in 0.517s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c997db4e-4a40-4af2-9cbb-7b37c859e252 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:25 devstack sudo[90665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c997db4e-4a40-4af2-9cbb-7b37c859e252 Nov 05 03:44:25 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9d375466-6d42-44d1-8098-3e26942a6f75 tempest-GroupsV314Test-2112661973 None] Acquiring lock "cinder-quobyte-d3cf3876-cc49-404f-a796-dbc318c7e25a" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9d375466-6d42-44d1-8098-3e26942a6f75 tempest-GroupsV314Test-2112661973 None] Lock "cinder-quobyte-d3cf3876-cc49-404f-a796-dbc318c7e25a" acquired by "delete_volume" :: waited 0.026s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:25 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e64dc56-30b8-44e2-bb42-a1519236b8db]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:44:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9d375466-6d42-44d1-8098-3e26942a6f75 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d3cf3876-cc49-404f-a796-dbc318c7e25a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:25 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c997db4e-4a40-4af2-9cbb-7b37c859e252" returned: 0 in 0.369s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:44:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d96846-6a9f-48df-879b-4f621896f698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c997db4e-4a40-4af2-9cbb-7b37c859e252', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab61b18-2eeb-45a9-a34f-840c86c35348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:25 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Volume volume-c997db4e-4a40-4af2-9cbb-7b37c859e252 (c997db4e-4a40-4af2-9cbb-7b37c859e252): created successfully Nov 05 03:44:25 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d3cf3876-cc49-404f-a796-dbc318c7e25a Nov 05 03:44:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab61b18-2eeb-45a9-a34f-840c86c35348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:25 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Flow 'volume_create_manager' (2045d1fe-f23b-4b8e-ab13-3bfbf5119c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:44:25 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-149615b8-4203-4532-9947-e1caac619a40 tempest-ServerRescueNegativeTestJSON-1955723075 None] Created volume successfully. Nov 05 03:44:26 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9d375466-6d42-44d1-8098-3e26942a6f75 tempest-GroupsV314Test-2112661973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d3cf3876-cc49-404f-a796-dbc318c7e25a" returned: 0 in 0.447s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9d375466-6d42-44d1-8098-3e26942a6f75 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d3cf3876-cc49-404f-a796-dbc318c7e25a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:26 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d3cf3876-cc49-404f-a796-dbc318c7e25a Nov 05 03:44:26 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:26 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9d375466-6d42-44d1-8098-3e26942a6f75 tempest-GroupsV314Test-2112661973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d3cf3876-cc49-404f-a796-dbc318c7e25a" returned: 0 in 0.364s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9d375466-6d42-44d1-8098-3e26942a6f75 tempest-GroupsV314Test-2112661973 None] Lock "cinder-quobyte-d3cf3876-cc49-404f-a796-dbc318c7e25a" released by "delete_volume" :: held 0.892s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:44:26 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-9d375466-6d42-44d1-8098-3e26942a6f75 tempest-GroupsV314Test-2112661973 None] Created reservations ['647ea273-fe3f-44da-95fa-13dfacbf67df'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:44:26 devstack cinder-volume[87109]: WARNING cinder.quota [None req-9d375466-6d42-44d1-8098-3e26942a6f75 tempest-GroupsV314Test-2112661973 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-462194803 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-462194803, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:44:26 devstack cinder-volume[87109]: WARNING cinder.quota [None req-9d375466-6d42-44d1-8098-3e26942a6f75 tempest-GroupsV314Test-2112661973 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-462194803 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-462194803, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:44:26 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-9d375466-6d42-44d1-8098-3e26942a6f75 tempest-GroupsV314Test-2112661973 None] Created reservations ['a8472b5f-6c24-4926-aa70-625f8821cacc', '7a29290f-92de-49c2-ad1e-f20620095fbc', '551351b3-287d-43aa-aba9-a16222f3eb36', '688d08eb-73ac-4b5b-b57a-417ef2abf94b'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:44:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9d375466-6d42-44d1-8098-3e26942a6f75 tempest-GroupsV314Test-2112661973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9d375466-6d42-44d1-8098-3e26942a6f75 tempest-GroupsV314Test-2112661973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9d375466-6d42-44d1-8098-3e26942a6f75 tempest-GroupsV314Test-2112661973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:44:27 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9d375466-6d42-44d1-8098-3e26942a6f75 tempest-GroupsV314Test-2112661973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:44:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9d375466-6d42-44d1-8098-3e26942a6f75 tempest-GroupsV314Test-2112661973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9d375466-6d42-44d1-8098-3e26942a6f75 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:27 devstack sudo[90677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:44:27 devstack sudo[90677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:27 devstack sudo[90677]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9d375466-6d42-44d1-8098-3e26942a6f75 tempest-GroupsV314Test-2112661973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.392s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:27 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-9d375466-6d42-44d1-8098-3e26942a6f75 tempest-GroupsV314Test-2112661973 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:44:27 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-9d375466-6d42-44d1-8098-3e26942a6f75 tempest-GroupsV314Test-2112661973 None] Delete group completed successfully. Nov 05 03:44:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4f13be0c-c9e6-4376-8cb9-34657708cbe7 tempest-GroupsV314Test-2112661973 None] Acquiring lock "cinder-quobyte-e87a4ad1-a9b5-440a-bf0c-ede586b28764" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4f13be0c-c9e6-4376-8cb9-34657708cbe7 tempest-GroupsV314Test-2112661973 None] Lock "cinder-quobyte-e87a4ad1-a9b5-440a-bf0c-ede586b28764" acquired by "delete_volume" :: waited 0.022s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:28 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c01784-8660-4d23-b91c-afad149c1eac]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:44:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4f13be0c-c9e6-4376-8cb9-34657708cbe7 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:28 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 Nov 05 03:44:28 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:29 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4f13be0c-c9e6-4376-8cb9-34657708cbe7 tempest-GroupsV314Test-2112661973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764" returned: 0 in 0.626s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4f13be0c-c9e6-4376-8cb9-34657708cbe7 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:29 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764 Nov 05 03:44:29 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:29 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4f13be0c-c9e6-4376-8cb9-34657708cbe7 tempest-GroupsV314Test-2112661973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e87a4ad1-a9b5-440a-bf0c-ede586b28764" returned: 0 in 0.432s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4f13be0c-c9e6-4376-8cb9-34657708cbe7 tempest-GroupsV314Test-2112661973 None] Lock "cinder-quobyte-e87a4ad1-a9b5-440a-bf0c-ede586b28764" released by "delete_volume" :: held 1.199s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:44:29 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-4f13be0c-c9e6-4376-8cb9-34657708cbe7 tempest-GroupsV314Test-2112661973 None] Created reservations ['a017ff50-0480-4e63-b630-8f82abe0a59b'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:44:29 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-4f13be0c-c9e6-4376-8cb9-34657708cbe7 tempest-GroupsV314Test-2112661973 None] Created reservations ['5190d0bc-c3a0-4ef4-97d6-f7c2c4118de8', 'b8b2d0cd-e28b-45ab-9770-72f4ebcf9062', '04b7a426-14e2-4f97-94a4-533f12dfa8e1', '2a7d5718-ed55-454a-9fac-6eed3c95f095'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:44:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4f13be0c-c9e6-4376-8cb9-34657708cbe7 tempest-GroupsV314Test-2112661973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4f13be0c-c9e6-4376-8cb9-34657708cbe7 tempest-GroupsV314Test-2112661973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4f13be0c-c9e6-4376-8cb9-34657708cbe7 tempest-GroupsV314Test-2112661973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:44:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4f13be0c-c9e6-4376-8cb9-34657708cbe7 tempest-GroupsV314Test-2112661973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:44:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4f13be0c-c9e6-4376-8cb9-34657708cbe7 tempest-GroupsV314Test-2112661973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4f13be0c-c9e6-4376-8cb9-34657708cbe7 tempest-GroupsV314Test-2112661973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:30 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:44:30 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:30 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4f13be0c-c9e6-4376-8cb9-34657708cbe7 tempest-GroupsV314Test-2112661973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.453s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:30 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-4f13be0c-c9e6-4376-8cb9-34657708cbe7 tempest-GroupsV314Test-2112661973 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:44:30 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-4f13be0c-c9e6-4376-8cb9-34657708cbe7 tempest-GroupsV314Test-2112661973 None] Delete group completed successfully. Nov 05 03:44:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-79eec1b9-a20f-4913-8e20-88fdf7635ab7 tempest-ServerRescueNegativeTestJSON-1955723075 None] Acquiring lock "cinder-c997db4e-4a40-4af2-9cbb-7b37c859e252-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-79eec1b9-a20f-4913-8e20-88fdf7635ab7 tempest-ServerRescueNegativeTestJSON-1955723075 None] Lock "cinder-c997db4e-4a40-4af2-9cbb-7b37c859e252-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-79eec1b9-a20f-4913-8e20-88fdf7635ab7 tempest-ServerRescueNegativeTestJSON-1955723075 None] Acquiring lock "cinder-quobyte-c997db4e-4a40-4af2-9cbb-7b37c859e252" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:44:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-79eec1b9-a20f-4913-8e20-88fdf7635ab7 tempest-ServerRescueNegativeTestJSON-1955723075 None] Lock "cinder-quobyte-c997db4e-4a40-4af2-9cbb-7b37c859e252" acquired by "delete_volume" :: waited 0.022s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:44:35 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1205aa-70c7-4ce2-9e20-4a3badad43fa]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:44:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-79eec1b9-a20f-4913-8e20-88fdf7635ab7 tempest-ServerRescueNegativeTestJSON-1955723075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c997db4e-4a40-4af2-9cbb-7b37c859e252 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:35 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c997db4e-4a40-4af2-9cbb-7b37c859e252 Nov 05 03:44:35 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:35 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Flow 'volume_create_manager' (61c7856d-31c8-44d7-b145-c798497ab8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c62e589-6222-4a81-85aa-0e386e5a6be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c62e589-6222-4a81-85aa-0e386e5a6be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2042748150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c641c2ac-7537-451e-a33f-06df6b2ccd9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33a759785d9444da8fd65bd9a0341878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:36Z,use_quota=True,user_id='30c9e04aa5394e5792fb0138b08012d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab81e973-3a53-4b22-9df6-d6cb9a6b5ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab81e973-3a53-4b22-9df6-d6cb9a6b5ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf96083c-0d76-45af-9c5a-b16126662802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf96083c-0d76-45af-9c5a-b16126662802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c641c2ac-7537-451e-a33f-06df6b2ccd9f', 'volume_name': 'volume-c641c2ac-7537-451e-a33f-06df6b2ccd9f', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c865c9a-a008-4d80-aad5-48f970bab083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c865c9a-a008-4d80-aad5-48f970bab083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1f0f25-76d0-4b52-8824-cc839dd2d8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:36 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Volume c641c2ac-7537-451e-a33f-06df6b2ccd9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c641c2ac-7537-451e-a33f-06df6b2ccd9f', 'volume_size': 1} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:44:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2042748150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c641c2ac-7537-451e-a33f-06df6b2ccd9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33a759785d9444da8fd65bd9a0341878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:44:36Z,use_quota=True,user_id='30c9e04aa5394e5792fb0138b08012d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Creating volume c641c2ac-7537-451e-a33f-06df6b2ccd9f {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:44:36 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c641c2ac-7537-451e-a33f-06df6b2ccd9f 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:36 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c641c2ac-7537-451e-a33f-06df6b2ccd9f 1073741824 Nov 05 03:44:36 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:36 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-79eec1b9-a20f-4913-8e20-88fdf7635ab7 tempest-ServerRescueNegativeTestJSON-1955723075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c997db4e-4a40-4af2-9cbb-7b37c859e252" returned: 0 in 0.751s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-79eec1b9-a20f-4913-8e20-88fdf7635ab7 tempest-ServerRescueNegativeTestJSON-1955723075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c997db4e-4a40-4af2-9cbb-7b37c859e252 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:36 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c997db4e-4a40-4af2-9cbb-7b37c859e252 Nov 05 03:44:36 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:36 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-79eec1b9-a20f-4913-8e20-88fdf7635ab7 tempest-ServerRescueNegativeTestJSON-1955723075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c997db4e-4a40-4af2-9cbb-7b37c859e252" returned: 0 in 0.432s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-79eec1b9-a20f-4913-8e20-88fdf7635ab7 tempest-ServerRescueNegativeTestJSON-1955723075 None] Lock "cinder-quobyte-c997db4e-4a40-4af2-9cbb-7b37c859e252" released by "delete_volume" :: held 1.268s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-79eec1b9-a20f-4913-8e20-88fdf7635ab7 tempest-ServerRescueNegativeTestJSON-1955723075 None] Created reservations ['fc2a2a56-8901-4fe2-995e-5df12f3c30d4', 'f30d0907-9663-4f2f-88f7-9872d0367e36', 'e03ea77c-f68e-4dcc-9806-6080ee2f973f', 'b7c347e5-87da-4bc8-bc63-61abca5edc62'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:44:36 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c641c2ac-7537-451e-a33f-06df6b2ccd9f 1073741824" returned: 0 in 0.811s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-79eec1b9-a20f-4913-8e20-88fdf7635ab7 tempest-ServerRescueNegativeTestJSON-1955723075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-79eec1b9-a20f-4913-8e20-88fdf7635ab7 tempest-ServerRescueNegativeTestJSON-1955723075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-79eec1b9-a20f-4913-8e20-88fdf7635ab7 tempest-ServerRescueNegativeTestJSON-1955723075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-79eec1b9-a20f-4913-8e20-88fdf7635ab7 tempest-ServerRescueNegativeTestJSON-1955723075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-79eec1b9-a20f-4913-8e20-88fdf7635ab7 tempest-ServerRescueNegativeTestJSON-1955723075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-79eec1b9-a20f-4913-8e20-88fdf7635ab7 tempest-ServerRescueNegativeTestJSON-1955723075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c641c2ac-7537-451e-a33f-06df6b2ccd9f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:37 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:44:37 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:37 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c641c2ac-7537-451e-a33f-06df6b2ccd9f Nov 05 03:44:37 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:37 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-79eec1b9-a20f-4913-8e20-88fdf7635ab7 tempest-ServerRescueNegativeTestJSON-1955723075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.443s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:37 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-79eec1b9-a20f-4913-8e20-88fdf7635ab7 tempest-ServerRescueNegativeTestJSON-1955723075 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:44:37 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-79eec1b9-a20f-4913-8e20-88fdf7635ab7 tempest-ServerRescueNegativeTestJSON-1955723075 None] Deleted volume successfully. Nov 05 03:44:37 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-79eec1b9-a20f-4913-8e20-88fdf7635ab7 tempest-ServerRescueNegativeTestJSON-1955723075 None] Lock "cinder-c997db4e-4a40-4af2-9cbb-7b37c859e252-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:44:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c641c2ac-7537-451e-a33f-06df6b2ccd9f" returned: 0 in 0.488s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:44:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1f0f25-76d0-4b52-8824-cc839dd2d8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c641c2ac-7537-451e-a33f-06df6b2ccd9f', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10583819-4d1c-433b-a6ed-623ac5c8f1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:44:37 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Volume volume-c641c2ac-7537-451e-a33f-06df6b2ccd9f (c641c2ac-7537-451e-a33f-06df6b2ccd9f): created successfully Nov 05 03:44:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10583819-4d1c-433b-a6ed-623ac5c8f1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:44:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Flow 'volume_create_manager' (61c7856d-31c8-44d7-b145-c798497ab8ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:44:37 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-378ef394-3922-41d9-988b-ae924b2fb4fb tempest-AttachVolumeTestJSON-795486824 None] Created volume successfully. Nov 05 03:44:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-90c4e5b9-fa26-4fef-a636-44757774a548 req-8d08b137-0d01-43c2-8a24-3ee03135a656 tempest-AttachVolumeTestJSON-795486824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-90c4e5b9-fa26-4fef-a636-44757774a548 req-8d08b137-0d01-43c2-8a24-3ee03135a656 tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-90c4e5b9-fa26-4fef-a636-44757774a548 req-8d08b137-0d01-43c2-8a24-3ee03135a656 tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:39 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-90c4e5b9-fa26-4fef-a636-44757774a548 req-8d08b137-0d01-43c2-8a24-3ee03135a656 tempest-AttachVolumeTestJSON-795486824 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-c641c2ac-7537-451e-a33f-06df6b2ccd9f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09163284-5036-4bef-a984-bdbd41a31d41', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:44:39 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-90c4e5b9-fa26-4fef-a636-44757774a548 req-8d08b137-0d01-43c2-8a24-3ee03135a656 tempest-AttachVolumeTestJSON-795486824 None] attachment_update completed successfully. Nov 05 03:44:49 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=46,cinder:UPDATE=48,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:44:49 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=40,cinder:UPDATE=40,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:44:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-e5bdcf4c-6119-4c3a-bd07-55a53fb24320 req-059b2380-8fb5-4039-8104-98c7f394d2a1 tempest-ServerActionsTestOtherA-151106859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-e5bdcf4c-6119-4c3a-bd07-55a53fb24320 req-059b2380-8fb5-4039-8104-98c7f394d2a1 tempest-ServerActionsTestOtherA-151106859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-e5bdcf4c-6119-4c3a-bd07-55a53fb24320 req-059b2380-8fb5-4039-8104-98c7f394d2a1 tempest-ServerActionsTestOtherA-151106859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-e5bdcf4c-6119-4c3a-bd07-55a53fb24320 req-059b2380-8fb5-4039-8104-98c7f394d2a1 tempest-ServerActionsTestOtherA-151106859 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d506040-1c4a-40d6-a432-003d9e6ae36a', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:44:52 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-e5bdcf4c-6119-4c3a-bd07-55a53fb24320 req-059b2380-8fb5-4039-8104-98c7f394d2a1 tempest-ServerActionsTestOtherA-151106859 None] attachment_update completed successfully. Nov 05 03:44:56 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-a6ac1281-a456-4493-901c-025636960d53 req-2c9ce425-fad1-4de9-b2b2-ae1823c9cf96 tempest-ServerActionsTestOtherA-151106859 None] Terminate volume connection completed successfully. Nov 05 03:44:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-a6ac1281-a456-4493-901c-025636960d53 req-2c9ce425-fad1-4de9-b2b2-ae1823c9cf96 tempest-ServerActionsTestOtherA-151106859 None] Deleting attachment 7d506040-1c4a-40d6-a432-003d9e6ae36a. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:44:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-a6ac1281-a456-4493-901c-025636960d53 req-2045543a-41bc-49e7-b3ff-c4c3e69eaa7d tempest-ServerActionsTestOtherA-151106859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-a6ac1281-a456-4493-901c-025636960d53 req-2045543a-41bc-49e7-b3ff-c4c3e69eaa7d tempest-ServerActionsTestOtherA-151106859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-a6ac1281-a456-4493-901c-025636960d53 req-2045543a-41bc-49e7-b3ff-c4c3e69eaa7d tempest-ServerActionsTestOtherA-151106859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-a6ac1281-a456-4493-901c-025636960d53 req-2045543a-41bc-49e7-b3ff-c4c3e69eaa7d tempest-ServerActionsTestOtherA-151106859 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd491a576-d5a8-454b-95f3-734fbb9df0d9', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:44:58 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-a6ac1281-a456-4493-901c-025636960d53 req-2045543a-41bc-49e7-b3ff-c4c3e69eaa7d tempest-ServerActionsTestOtherA-151106859 None] attachment_update completed successfully. Nov 05 03:44:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:44:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:44:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:44:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:44:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:44:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:44:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:44:58 devstack sudo[91932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:44:58 devstack sudo[91932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:44:59 devstack sudo[91932]: pam_unix(sudo:session): session closed for user root Nov 05 03:44:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.620s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:44:59 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:44:59 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:44:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 8 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:44:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Flow 'volume_create_manager' (37ee3e23-d9d2-4081-87de-9f90b1e606f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c70ceb4-4858-4f28-88e6-d72a330168ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c70ceb4-4858-4f28-88e6-d72a330168ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-563854269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51944e1a-3573-4bb8-bffa-1320815654f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9702305fe8d45ed96033c52674b71ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:05Z,use_quota=True,user_id='d226b37a9c1e4e9bbd2542c88e587458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1878d38a-3d7b-44b8-8b74-c635c83449d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1878d38a-3d7b-44b8-8b74-c635c83449d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bfdc3a5-7fe1-4f34-9552-6c5d28cded45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bfdc3a5-7fe1-4f34-9552-6c5d28cded45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51944e1a-3573-4bb8-bffa-1320815654f8', 'volume_name': 'volume-51944e1a-3573-4bb8-bffa-1320815654f8', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0355a0bc-94d7-4814-bd19-a9b87902d03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0355a0bc-94d7-4814-bd19-a9b87902d03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa264b4-b5f4-4529-8648-e619422446b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:05 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Volume 51944e1a-3573-4bb8-bffa-1320815654f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51944e1a-3573-4bb8-bffa-1320815654f8', 'volume_size': 1} Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-563854269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51944e1a-3573-4bb8-bffa-1320815654f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9702305fe8d45ed96033c52674b71ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:05Z,use_quota=True,user_id='d226b37a9c1e4e9bbd2542c88e587458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Creating volume 51944e1a-3573-4bb8-bffa-1320815654f8 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:45:05 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:45:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51944e1a-3573-4bb8-bffa-1320815654f8 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:05 devstack sudo[92078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51944e1a-3573-4bb8-bffa-1320815654f8 1073741824 Nov 05 03:45:05 devstack sudo[92078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:06 devstack sudo[92078]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51944e1a-3573-4bb8-bffa-1320815654f8 1073741824" returned: 0 in 0.534s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51944e1a-3573-4bb8-bffa-1320815654f8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:06 devstack sudo[92083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51944e1a-3573-4bb8-bffa-1320815654f8 Nov 05 03:45:06 devstack sudo[92083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:06 devstack sudo[92083]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51944e1a-3573-4bb8-bffa-1320815654f8" returned: 0 in 0.320s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:45:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa264b4-b5f4-4529-8648-e619422446b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51944e1a-3573-4bb8-bffa-1320815654f8', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8adcf19-ad50-4d0a-b2b8-64698b113c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:06 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Volume volume-51944e1a-3573-4bb8-bffa-1320815654f8 (51944e1a-3573-4bb8-bffa-1320815654f8): created successfully Nov 05 03:45:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8adcf19-ad50-4d0a-b2b8-64698b113c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Flow 'volume_create_manager' (37ee3e23-d9d2-4081-87de-9f90b1e606f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:06 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-17c4413a-12d1-46dc-abc0-cae14d99da71 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Created volume successfully. Nov 05 03:45:07 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5f985798-1433-4ad4-83d3-f46c3964345a tempest-VolumeQuotasAdminTestJSON-1813218480 None] Acquiring lock "cinder-51944e1a-3573-4bb8-bffa-1320815654f8-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:07 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5f985798-1433-4ad4-83d3-f46c3964345a tempest-VolumeQuotasAdminTestJSON-1813218480 None] Lock "cinder-51944e1a-3573-4bb8-bffa-1320815654f8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:07 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5f985798-1433-4ad4-83d3-f46c3964345a tempest-VolumeQuotasAdminTestJSON-1813218480 None] Acquiring lock "cinder-quobyte-51944e1a-3573-4bb8-bffa-1320815654f8" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:07 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5f985798-1433-4ad4-83d3-f46c3964345a tempest-VolumeQuotasAdminTestJSON-1813218480 None] Lock "cinder-quobyte-51944e1a-3573-4bb8-bffa-1320815654f8" acquired by "delete_volume" :: waited 0.031s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:07 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd1fc8a-1188-470c-a47b-fe61189c9ccb]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:45:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5f985798-1433-4ad4-83d3-f46c3964345a tempest-VolumeQuotasAdminTestJSON-1813218480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51944e1a-3573-4bb8-bffa-1320815654f8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:08 devstack sudo[92086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51944e1a-3573-4bb8-bffa-1320815654f8 Nov 05 03:45:08 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:08 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5f985798-1433-4ad4-83d3-f46c3964345a tempest-VolumeQuotasAdminTestJSON-1813218480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51944e1a-3573-4bb8-bffa-1320815654f8" returned: 0 in 0.526s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5f985798-1433-4ad4-83d3-f46c3964345a tempest-VolumeQuotasAdminTestJSON-1813218480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51944e1a-3573-4bb8-bffa-1320815654f8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:08 devstack sudo[92091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51944e1a-3573-4bb8-bffa-1320815654f8 Nov 05 03:45:08 devstack sudo[92091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:08 devstack sudo[92091]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5f985798-1433-4ad4-83d3-f46c3964345a tempest-VolumeQuotasAdminTestJSON-1813218480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51944e1a-3573-4bb8-bffa-1320815654f8" returned: 0 in 0.301s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5f985798-1433-4ad4-83d3-f46c3964345a tempest-VolumeQuotasAdminTestJSON-1813218480 None] Lock "cinder-quobyte-51944e1a-3573-4bb8-bffa-1320815654f8" released by "delete_volume" :: held 0.892s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:08 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-5f985798-1433-4ad4-83d3-f46c3964345a tempest-VolumeQuotasAdminTestJSON-1813218480 None] Created reservations ['8b25cfea-c83d-4aae-8e2d-bbfbce819a1e', 'f0acdef6-4f8a-422f-ad2d-86fa5b2873ae', '3140673d-6504-4f05-9a05-e8e7b78e5e7f', '966fa175-7f10-4c99-a6ee-6c8b8ea1ddd3'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:45:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5f985798-1433-4ad4-83d3-f46c3964345a tempest-VolumeQuotasAdminTestJSON-1813218480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5f985798-1433-4ad4-83d3-f46c3964345a tempest-VolumeQuotasAdminTestJSON-1813218480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5f985798-1433-4ad4-83d3-f46c3964345a tempest-VolumeQuotasAdminTestJSON-1813218480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5f985798-1433-4ad4-83d3-f46c3964345a tempest-VolumeQuotasAdminTestJSON-1813218480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5f985798-1433-4ad4-83d3-f46c3964345a tempest-VolumeQuotasAdminTestJSON-1813218480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5f985798-1433-4ad4-83d3-f46c3964345a tempest-VolumeQuotasAdminTestJSON-1813218480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:09 devstack sudo[92095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:45:09 devstack sudo[92095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:09 devstack sudo[92095]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5f985798-1433-4ad4-83d3-f46c3964345a tempest-VolumeQuotasAdminTestJSON-1813218480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.379s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:09 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-5f985798-1433-4ad4-83d3-f46c3964345a tempest-VolumeQuotasAdminTestJSON-1813218480 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:45:09 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5f985798-1433-4ad4-83d3-f46c3964345a tempest-VolumeQuotasAdminTestJSON-1813218480 None] Deleted volume successfully. Nov 05 03:45:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5f985798-1433-4ad4-83d3-f46c3964345a tempest-VolumeQuotasAdminTestJSON-1813218480 None] Lock "cinder-51944e1a-3573-4bb8-bffa-1320815654f8-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Flow 'volume_create_manager' (fb15e1d4-ad2d-43f1-889b-67e7b265cab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdeb5c1c-124c-4c0f-a7d0-c81a583d837d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdeb5c1c-124c-4c0f-a7d0-c81a583d837d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1736589894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf2986e-7f1b-438c-817e-62f83b119510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9702305fe8d45ed96033c52674b71ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:11Z,use_quota=True,user_id='d226b37a9c1e4e9bbd2542c88e587458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6583519e-d663-464e-a44a-aaac5d9c9ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6583519e-d663-464e-a44a-aaac5d9c9ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa294fff-f5d9-4881-b3c3-85784671c6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa294fff-f5d9-4881-b3c3-85784671c6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bf2986e-7f1b-438c-817e-62f83b119510', 'volume_name': 'volume-0bf2986e-7f1b-438c-817e-62f83b119510', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392d1bf1-606f-4e95-a61f-43c8783d5eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (392d1bf1-606f-4e95-a61f-43c8783d5eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16420db-1279-406e-be55-d1a6e3aed54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:10 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Volume 0bf2986e-7f1b-438c-817e-62f83b119510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bf2986e-7f1b-438c-817e-62f83b119510', 'volume_size': 1} Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1736589894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf2986e-7f1b-438c-817e-62f83b119510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9702305fe8d45ed96033c52674b71ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:11Z,use_quota=True,user_id='d226b37a9c1e4e9bbd2542c88e587458',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Creating volume 0bf2986e-7f1b-438c-817e-62f83b119510 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:45:10 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:45:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0bf2986e-7f1b-438c-817e-62f83b119510 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:10 devstack sudo[92098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0bf2986e-7f1b-438c-817e-62f83b119510 1073741824 Nov 05 03:45:10 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:11 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0bf2986e-7f1b-438c-817e-62f83b119510 1073741824" returned: 0 in 0.526s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0bf2986e-7f1b-438c-817e-62f83b119510 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:11 devstack sudo[92104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0bf2986e-7f1b-438c-817e-62f83b119510 Nov 05 03:45:11 devstack sudo[92104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:11 devstack sudo[92104]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0bf2986e-7f1b-438c-817e-62f83b119510" returned: 0 in 0.292s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:11 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:45:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16420db-1279-406e-be55-d1a6e3aed54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bf2986e-7f1b-438c-817e-62f83b119510', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5787f905-19d7-4c7c-ac15-4431a3cb14cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:11 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Volume volume-0bf2986e-7f1b-438c-817e-62f83b119510 (0bf2986e-7f1b-438c-817e-62f83b119510): created successfully Nov 05 03:45:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5787f905-19d7-4c7c-ac15-4431a3cb14cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Flow 'volume_create_manager' (fb15e1d4-ad2d-43f1-889b-67e7b265cab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:11 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-c33f198b-d9aa-40de-afab-56e7b17f3627 tempest-VolumeQuotasAdminTestJSON-1813218480 None] Created volume successfully. Nov 05 03:45:12 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-5e429b36-cad5-466c-b74b-1c30e92c907f req-864a4153-1844-4ac3-8db6-9c13f1159dfe tempest-AttachVolumeTestJSON-795486824 None] Terminate volume connection completed successfully. Nov 05 03:45:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-5e429b36-cad5-466c-b74b-1c30e92c907f req-864a4153-1844-4ac3-8db6-9c13f1159dfe tempest-AttachVolumeTestJSON-795486824 None] Deleting attachment 09163284-5036-4bef-a984-bdbd41a31d41. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:45:14 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-e7fdb09d-8da9-4f02-80ae-83ba5708cec1 tempest-VolumeQuotasAdminTestJSON-1402166377 None] Transfer volume completed successfully. Nov 05 03:45:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cbf418db-dba3-4b92-b463-783d70c199e4 tempest-VolumeQuotasAdminTestJSON-1812680004 None] Acquiring lock "cinder-0bf2986e-7f1b-438c-817e-62f83b119510-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cbf418db-dba3-4b92-b463-783d70c199e4 tempest-VolumeQuotasAdminTestJSON-1812680004 None] Lock "cinder-0bf2986e-7f1b-438c-817e-62f83b119510-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cbf418db-dba3-4b92-b463-783d70c199e4 tempest-VolumeQuotasAdminTestJSON-1812680004 None] Acquiring lock "cinder-quobyte-0bf2986e-7f1b-438c-817e-62f83b119510" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cbf418db-dba3-4b92-b463-783d70c199e4 tempest-VolumeQuotasAdminTestJSON-1812680004 None] Lock "cinder-quobyte-0bf2986e-7f1b-438c-817e-62f83b119510" acquired by "delete_volume" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:14 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bffa7d-ff28-4e0c-9358-cb207df8c0db]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:45:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cbf418db-dba3-4b92-b463-783d70c199e4 tempest-VolumeQuotasAdminTestJSON-1812680004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0bf2986e-7f1b-438c-817e-62f83b119510 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:14 devstack sudo[92121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0bf2986e-7f1b-438c-817e-62f83b119510 Nov 05 03:45:14 devstack sudo[92121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:15 devstack sudo[92121]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cbf418db-dba3-4b92-b463-783d70c199e4 tempest-VolumeQuotasAdminTestJSON-1812680004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0bf2986e-7f1b-438c-817e-62f83b119510" returned: 0 in 0.584s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cbf418db-dba3-4b92-b463-783d70c199e4 tempest-VolumeQuotasAdminTestJSON-1812680004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0bf2986e-7f1b-438c-817e-62f83b119510 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:15 devstack sudo[92146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0bf2986e-7f1b-438c-817e-62f83b119510 Nov 05 03:45:15 devstack sudo[92146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:15 devstack sudo[92146]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cbf418db-dba3-4b92-b463-783d70c199e4 tempest-VolumeQuotasAdminTestJSON-1812680004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0bf2986e-7f1b-438c-817e-62f83b119510" returned: 0 in 0.367s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:15 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cbf418db-dba3-4b92-b463-783d70c199e4 tempest-VolumeQuotasAdminTestJSON-1812680004 None] Lock "cinder-quobyte-0bf2986e-7f1b-438c-817e-62f83b119510" released by "delete_volume" :: held 1.028s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:15 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-cbf418db-dba3-4b92-b463-783d70c199e4 tempest-VolumeQuotasAdminTestJSON-1812680004 None] Created reservations ['94797a0c-dda7-47a8-bf3f-e0e89258790c', '11d6df16-3219-42ff-90a3-79ca5d3d2134', '158569f7-86aa-48ff-95dd-53653e0136cb', '094d8ef4-cfee-4732-99ab-5ca5668f7da0'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:45:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-cbf418db-dba3-4b92-b463-783d70c199e4 tempest-VolumeQuotasAdminTestJSON-1812680004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-cbf418db-dba3-4b92-b463-783d70c199e4 tempest-VolumeQuotasAdminTestJSON-1812680004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-cbf418db-dba3-4b92-b463-783d70c199e4 tempest-VolumeQuotasAdminTestJSON-1812680004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-cbf418db-dba3-4b92-b463-783d70c199e4 tempest-VolumeQuotasAdminTestJSON-1812680004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-cbf418db-dba3-4b92-b463-783d70c199e4 tempest-VolumeQuotasAdminTestJSON-1812680004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cbf418db-dba3-4b92-b463-783d70c199e4 tempest-VolumeQuotasAdminTestJSON-1812680004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:15 devstack sudo[92149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:45:15 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:16 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cbf418db-dba3-4b92-b463-783d70c199e4 tempest-VolumeQuotasAdminTestJSON-1812680004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.280s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:16 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-cbf418db-dba3-4b92-b463-783d70c199e4 tempest-VolumeQuotasAdminTestJSON-1812680004 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:45:16 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-cbf418db-dba3-4b92-b463-783d70c199e4 tempest-VolumeQuotasAdminTestJSON-1812680004 None] Deleted volume successfully. Nov 05 03:45:16 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cbf418db-dba3-4b92-b463-783d70c199e4 tempest-VolumeQuotasAdminTestJSON-1812680004 None] Lock "cinder-0bf2986e-7f1b-438c-817e-62f83b119510-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:25 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=30,cinder:UPDATE=28,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:45:26 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=33,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:45:28 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-04f7d706-48e5-4e35-9b4e-14c9ba3fb7e1 req-b6f3c7a2-90cc-4daa-8d97-ae6caa594698 tempest-ServerActionsTestOtherA-151106859 None] Terminate volume connection completed successfully. Nov 05 03:45:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-04f7d706-48e5-4e35-9b4e-14c9ba3fb7e1 req-b6f3c7a2-90cc-4daa-8d97-ae6caa594698 tempest-ServerActionsTestOtherA-151106859 None] Deleting attachment d491a576-d5a8-454b-95f3-734fbb9df0d9. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Flow 'volume_create_manager' (9dfc1547-3c54-4967-a715-f8dfec5369e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f39cac-5d0c-4170-9fdf-b9a8d44fdb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f39cac-5d0c-4170-9fdf-b9a8d44fdb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-294989797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffdbbf62-b529-41e5-90e6-ca309a4d891c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a22a268a6e441059680963dde37490f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:32Z,use_quota=True,user_id='9485fb32acca464f955b2c9ebffb9997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ec46db-8b05-4f5c-ba1e-6c82ba7c2615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ec46db-8b05-4f5c-ba1e-6c82ba7c2615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9a5712-4f3c-4fb8-9d77-9e021eaa6a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9a5712-4f3c-4fb8-9d77-9e021eaa6a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffdbbf62-b529-41e5-90e6-ca309a4d891c', 'volume_name': 'volume-ffdbbf62-b529-41e5-90e6-ca309a4d891c', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e4aede-6a6b-46e4-a930-654487f422fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e4aede-6a6b-46e4-a930-654487f422fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d1b56d-c99c-4959-bd41-30eef1824b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:31 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Volume ffdbbf62-b529-41e5-90e6-ca309a4d891c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffdbbf62-b529-41e5-90e6-ca309a4d891c', 'volume_size': 1} Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-294989797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffdbbf62-b529-41e5-90e6-ca309a4d891c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a22a268a6e441059680963dde37490f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:32Z,use_quota=True,user_id='9485fb32acca464f955b2c9ebffb9997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Creating volume ffdbbf62-b529-41e5-90e6-ca309a4d891c {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:45:31 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:45:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ffdbbf62-b529-41e5-90e6-ca309a4d891c 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:31 devstack sudo[92408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ffdbbf62-b529-41e5-90e6-ca309a4d891c 1073741824 Nov 05 03:45:31 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:32 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ffdbbf62-b529-41e5-90e6-ca309a4d891c 1073741824" returned: 0 in 0.842s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ffdbbf62-b529-41e5-90e6-ca309a4d891c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:32 devstack sudo[92416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ffdbbf62-b529-41e5-90e6-ca309a4d891c Nov 05 03:45:32 devstack sudo[92416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:33 devstack sudo[92416]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ffdbbf62-b529-41e5-90e6-ca309a4d891c" returned: 0 in 0.337s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:45:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d1b56d-c99c-4959-bd41-30eef1824b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffdbbf62-b529-41e5-90e6-ca309a4d891c', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a862959d-2cb1-4cb5-bec1-c40bd336a168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:33 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Volume volume-ffdbbf62-b529-41e5-90e6-ca309a4d891c (ffdbbf62-b529-41e5-90e6-ca309a4d891c): created successfully Nov 05 03:45:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a862959d-2cb1-4cb5-bec1-c40bd336a168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Flow 'volume_create_manager' (9dfc1547-3c54-4967-a715-f8dfec5369e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:33 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-1537d9d5-7e68-4c9f-bc28-293dac261e3c tempest-VolumeQuotasNegativeTestJSON-790013032 None] Created volume successfully. Nov 05 03:45:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b5241360-165a-47f9-a53a-17049f8c9ad3 tempest-VolumeQuotasNegativeTestJSON-790013032 None] Acquiring lock "cinder-ffdbbf62-b529-41e5-90e6-ca309a4d891c-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b5241360-165a-47f9-a53a-17049f8c9ad3 tempest-VolumeQuotasNegativeTestJSON-790013032 None] Lock "cinder-ffdbbf62-b529-41e5-90e6-ca309a4d891c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b5241360-165a-47f9-a53a-17049f8c9ad3 tempest-VolumeQuotasNegativeTestJSON-790013032 None] Acquiring lock "cinder-quobyte-ffdbbf62-b529-41e5-90e6-ca309a4d891c" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b5241360-165a-47f9-a53a-17049f8c9ad3 tempest-VolumeQuotasNegativeTestJSON-790013032 None] Lock "cinder-quobyte-ffdbbf62-b529-41e5-90e6-ca309a4d891c" acquired by "delete_volume" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:35 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86a5493-6fb3-4172-b4df-8d023a0dfae6]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:45:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b5241360-165a-47f9-a53a-17049f8c9ad3 tempest-VolumeQuotasNegativeTestJSON-790013032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ffdbbf62-b529-41e5-90e6-ca309a4d891c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:35 devstack sudo[92424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ffdbbf62-b529-41e5-90e6-ca309a4d891c Nov 05 03:45:35 devstack sudo[92424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:35 devstack sudo[92424]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b5241360-165a-47f9-a53a-17049f8c9ad3 tempest-VolumeQuotasNegativeTestJSON-790013032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ffdbbf62-b529-41e5-90e6-ca309a4d891c" returned: 0 in 0.435s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b5241360-165a-47f9-a53a-17049f8c9ad3 tempest-VolumeQuotasNegativeTestJSON-790013032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ffdbbf62-b529-41e5-90e6-ca309a4d891c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:35 devstack sudo[92429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ffdbbf62-b529-41e5-90e6-ca309a4d891c Nov 05 03:45:35 devstack sudo[92429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:36 devstack sudo[92429]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b5241360-165a-47f9-a53a-17049f8c9ad3 tempest-VolumeQuotasNegativeTestJSON-790013032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ffdbbf62-b529-41e5-90e6-ca309a4d891c" returned: 0 in 0.278s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b5241360-165a-47f9-a53a-17049f8c9ad3 tempest-VolumeQuotasNegativeTestJSON-790013032 None] Lock "cinder-quobyte-ffdbbf62-b529-41e5-90e6-ca309a4d891c" released by "delete_volume" :: held 0.756s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:36 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-b5241360-165a-47f9-a53a-17049f8c9ad3 tempest-VolumeQuotasNegativeTestJSON-790013032 None] Created reservations ['4fa6f356-f8f2-4e54-8eea-081b8ad7b0a0', 'a1b1a203-0596-48da-bdc4-f3c11b0c82c7', '0e5d262c-173f-468a-abd9-d994f2b5a0c4', '913ac65e-6442-4d25-934a-1467f0f64b64'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:45:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b5241360-165a-47f9-a53a-17049f8c9ad3 tempest-VolumeQuotasNegativeTestJSON-790013032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b5241360-165a-47f9-a53a-17049f8c9ad3 tempest-VolumeQuotasNegativeTestJSON-790013032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b5241360-165a-47f9-a53a-17049f8c9ad3 tempest-VolumeQuotasNegativeTestJSON-790013032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b5241360-165a-47f9-a53a-17049f8c9ad3 tempest-VolumeQuotasNegativeTestJSON-790013032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b5241360-165a-47f9-a53a-17049f8c9ad3 tempest-VolumeQuotasNegativeTestJSON-790013032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b5241360-165a-47f9-a53a-17049f8c9ad3 tempest-VolumeQuotasNegativeTestJSON-790013032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:36 devstack sudo[92432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:45:36 devstack sudo[92432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:36 devstack sudo[92432]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b5241360-165a-47f9-a53a-17049f8c9ad3 tempest-VolumeQuotasNegativeTestJSON-790013032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.304s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:36 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-b5241360-165a-47f9-a53a-17049f8c9ad3 tempest-VolumeQuotasNegativeTestJSON-790013032 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:45:36 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b5241360-165a-47f9-a53a-17049f8c9ad3 tempest-VolumeQuotasNegativeTestJSON-790013032 None] Deleted volume successfully. Nov 05 03:45:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b5241360-165a-47f9-a53a-17049f8c9ad3 tempest-VolumeQuotasNegativeTestJSON-790013032 None] Lock "cinder-ffdbbf62-b529-41e5-90e6-ca309a4d891c-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:37 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:45:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Flow 'volume_create_manager' (004e4b42-02a3-4c05-b07c-e7119d0d3c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ecf7bf-f025-41ff-ac70-9993d0abe5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ecf7bf-f025-41ff-ac70-9993d0abe5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1447220780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb665edb-1e27-462f-8c66-ed9ce5c770e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6dbdbe2edb643fb94315774309f8c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:37Z,use_quota=True,user_id='3c413b5b5ab34818bb3d4454e0eabcb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b01a192-53ca-454d-b238-3315a795e9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b01a192-53ca-454d-b238-3315a795e9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a898627-4d39-4f47-b540-862091641549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:37 devstack cinder-volume[87109]: DEBUG cinder.image.glance [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Creating Keystone auth plugin from conf {{(pid=87109) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 03:45:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a898627-4d39-4f47-b540-862091641549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fb665edb-1e27-462f-8c66-ed9ce5c770e7', 'volume_name': 'volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7', 'volume_size': 1, 'image_id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9a2a266d3247698576f415a1551384', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd055ed2-66eb-4dfb-b98a-44b63bd9e651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd055ed2-66eb-4dfb-b98a-44b63bd9e651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d9ed64-f5e8-4bcd-9086-fd6df9ae6ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:38 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Volume fb665edb-1e27-462f-8c66-ed9ce5c770e7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7', 'volume_size': 1, 'image_id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9a2a266d3247698576f415a1551384', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 03:45:38 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Trying to clone fb665edb-1e27-462f-8c66-ed9ce5c770e7 from image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}]). {{(pid=87109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 03:45:38 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_tdeqdpc1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 05 03:45:38 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Image download 20.69 MB at 20.69 MB/s Nov 05 03:45:38 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c69d4ea-4677-4dde-9d27-4fc53354cd44]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:45:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_tdeqdpc1devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:38 devstack sudo[92457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_tdeqdpc1devstack@QuobyteHD Nov 05 03:45:38 devstack sudo[92457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:38 devstack sudo[92457]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_tdeqdpc1devstack@QuobyteHD" returned: 0 in 0.343s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:38 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Temporary image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 is fetched for user 3c413b5b5ab34818bb3d4454e0eabcb3. {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 05 03:45:39 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd3d6d9-01cd-4de6-b824-2d9a0b2689bd]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:45:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_tdeqdpc1devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:39 devstack sudo[92463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_tdeqdpc1devstack@QuobyteHD Nov 05 03:45:39 devstack sudo[92463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:39 devstack sudo[92463]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_tdeqdpc1devstack@QuobyteHD" returned: 0 in 0.406s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1447220780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb665edb-1e27-462f-8c66-ed9ce5c770e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6dbdbe2edb643fb94315774309f8c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:37Z,use_quota=True,user_id='3c413b5b5ab34818bb3d4454e0eabcb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:45:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Creating volume fb665edb-1e27-462f-8c66-ed9ce5c770e7 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:45:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:45:39 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:45:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:39 devstack sudo[92489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7 1073741824 Nov 05 03:45:39 devstack sudo[92489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:40 devstack sudo[92489]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7 1073741824" returned: 0 in 0.552s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:40 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7 Nov 05 03:45:40 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:40 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7" returned: 0 in 0.288s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:40 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:45:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:40 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Attempting download of b71101b4-5e1f-4b78-90ce-ec8cda8c1237 ((None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}])) to volume fb665edb-1e27-462f-8c66-ed9ce5c770e7. {{(pid=87109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 05 03:45:40 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0caae306-551c-4f62-84ba-cd1547df9ee3]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:45:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_7mdbhtqv {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:40 devstack sudo[92498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_7mdbhtqv Nov 05 03:45:40 devstack sudo[92498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:40 devstack sudo[92498]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_7mdbhtqv" returned: 0 in 0.417s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_7mdbhtqv {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:41 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_7mdbhtqv Nov 05 03:45:41 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:41 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_7mdbhtqv" returned: 1 in 0.384s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_7mdbhtqv' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:45:41 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd15224-5837-4fd3-a972-be9f0326b3c3]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:45:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_tdeqdpc1devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:41 devstack sudo[92506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_tdeqdpc1devstack@QuobyteHD Nov 05 03:45:41 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:41 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_tdeqdpc1devstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:41 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] b71101b4-5e1f-4b78-90ce-ec8cda8c1237 was qcow2, converting to qcow2 {{(pid=87109) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 05 03:45:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_tdeqdpc1devstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:41 devstack sudo[92511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_tdeqdpc1devstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7 Nov 05 03:45:41 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:44 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_tdeqdpc1devstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7" returned: 0 in 2.460s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_tdeqdpc1devstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7 {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:45:44 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Converted 112.00 MB image at 45.51 MB/s Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:44 devstack sudo[92547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7 1G Nov 05 03:45:44 devstack sudo[92547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Flow 'volume_create_manager' (8f42a9a8-5247-4a4a-9585-aedd50e4d1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99bcd4a-9eb0-4e57-abed-9c1d9454e0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e99bcd4a-9eb0-4e57-abed-9c1d9454e0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1898983406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0286ca9d686047eab0e13b5980690683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:44Z,use_quota=True,user_id='02845cc37d014a38b46730090a1c3a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98679009-165d-447b-a29a-19081c0dab53),volume_type_id=98679009-165d-447b-a29a-19081c0dab53)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7a1c64-2677-4311-8525-580e8950b2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7a1c64-2677-4311-8525-580e8950b2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1098f4-a17e-4ed3-acb3-12658e2e4f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1098f4-a17e-4ed3-acb3-12658e2e4f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421', 'volume_name': 'volume-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78e0cb1-ef67-4fda-845f-04c241c3256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a78e0cb1-ef67-4fda-845f-04c241c3256d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e619847-23e9-4a68-a8a4-f6e0c3736d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:44 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Volume a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421', 'volume_size': 1} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1898983406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0286ca9d686047eab0e13b5980690683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:44Z,use_quota=True,user_id='02845cc37d014a38b46730090a1c3a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(98679009-165d-447b-a29a-19081c0dab53),volume_type_id=98679009-165d-447b-a29a-19081c0dab53)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Creating volume a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:45:44 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:44 devstack sudo[92550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421 1073741824 Nov 05 03:45:44 devstack sudo[92550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:44 devstack sudo[92547]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7 1G" returned: 0 in 0.389s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Downloaded image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 ((None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}])) to volume fb665edb-1e27-462f-8c66-ed9ce5c770e7 successfully. {{(pid=87109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Temporary image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 for user 3c413b5b5ab34818bb3d4454e0eabcb3 is deleted. {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Marking volume fb665edb-1e27-462f-8c66-ed9ce5c770e7 as bootable. {{(pid=87109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Copying metadata from image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 to fb665edb-1e27-462f-8c66-ed9ce5c770e7. {{(pid=87109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Creating volume glance metadata for volume fb665edb-1e27-462f-8c66-ed9ce5c770e7 backed by image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d9ed64-f5e8-4bcd-9086-fd6df9ae6ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7', 'volume_size': 1, 'image_id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9a2a266d3247698576f415a1551384', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc814c4-a26e-402e-85ee-2bf13e2e6125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:44 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Volume volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7 (fb665edb-1e27-462f-8c66-ed9ce5c770e7): created successfully Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc814c4-a26e-402e-85ee-2bf13e2e6125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Flow 'volume_create_manager' (004e4b42-02a3-4c05-b07c-e7119d0d3c8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:44 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-88c27615-8507-40d6-bdc4-37c5fcf2f401 tempest-ServerActionsTestOtherA-151106859 None] Created volume successfully. Nov 05 03:45:44 devstack sudo[92550]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421 1073741824" returned: 0 in 0.523s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:44 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421 Nov 05 03:45:44 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:45 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421" returned: 0 in 0.283s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:45 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:45:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e619847-23e9-4a68-a8a4-f6e0c3736d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb6e566-e0a6-41b5-9bdb-b077121d6aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:45 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Volume volume-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421 (a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421): created successfully Nov 05 03:45:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb6e566-e0a6-41b5-9bdb-b077121d6aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Flow 'volume_create_manager' (8f42a9a8-5247-4a4a-9585-aedd50e4d1eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:45 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-4b11d5d8-50c3-4621-8875-f42328f82dda tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Created volume successfully. Nov 05 03:45:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1f065a2d-bbf6-4949-a4cb-5fbcc063521c tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1f065a2d-bbf6-4949-a4cb-5fbcc063521c tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1f065a2d-bbf6-4949-a4cb-5fbcc063521c tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1f065a2d-bbf6-4949-a4cb-5fbcc063521c tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1f065a2d-bbf6-4949-a4cb-5fbcc063521c tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1f065a2d-bbf6-4949-a4cb-5fbcc063521c tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:46 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:45:46 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:47 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1f065a2d-bbf6-4949-a4cb-5fbcc063521c tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.290s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:47 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-1f065a2d-bbf6-4949-a4cb-5fbcc063521c tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:45:47 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-1f065a2d-bbf6-4949-a4cb-5fbcc063521c tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Retype volume completed successfully. Nov 05 03:45:48 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Acquiring lock "cinder-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:48 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Lock "cinder-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:48 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Acquiring lock "cinder-quobyte-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:45:48 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Lock "cinder-quobyte-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421" acquired by "delete_volume" :: waited 0.020s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:45:48 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3a611f-f81a-4231-9d7c-2695011718d2]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:45:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:48 devstack sudo[92571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421 Nov 05 03:45:48 devstack sudo[92571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:48 devstack sudo[92571]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-b96fcaa9-0ab2-41e3-9329-ccbe6544eca8 req-20fae59c-6d35-4e6b-9b73-0e07cfd3d774 tempest-ServerActionsTestOtherA-151106859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-b96fcaa9-0ab2-41e3-9329-ccbe6544eca8 req-20fae59c-6d35-4e6b-9b73-0e07cfd3d774 tempest-ServerActionsTestOtherA-151106859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421" returned: 0 in 0.493s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-b96fcaa9-0ab2-41e3-9329-ccbe6544eca8 req-20fae59c-6d35-4e6b-9b73-0e07cfd3d774 tempest-ServerActionsTestOtherA-151106859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:49 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421 Nov 05 03:45:49 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:49 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-b96fcaa9-0ab2-41e3-9329-ccbe6544eca8 req-20fae59c-6d35-4e6b-9b73-0e07cfd3d774 tempest-ServerActionsTestOtherA-151106859 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '249c87bd-c756-44bc-ae8c-a106cb4e6c44', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:45:49 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-b96fcaa9-0ab2-41e3-9329-ccbe6544eca8 req-20fae59c-6d35-4e6b-9b73-0e07cfd3d774 tempest-ServerActionsTestOtherA-151106859 None] attachment_update completed successfully. Nov 05 03:45:49 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421" returned: 0 in 0.352s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Lock "cinder-quobyte-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421" released by "delete_volume" :: held 0.924s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:49 devstack cinder-volume[87109]: WARNING cinder.quota [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:45:49 devstack cinder-volume[87109]: WARNING cinder.quota [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:45:49 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Created reservations ['966da3b3-9210-473d-bdd2-02b2d7cca9d3', '3c322f48-6142-4d87-8ba4-0728b7d18784', 'c13fc8dd-3b4e-482b-980f-e615c2070788', '484529a4-5e46-4ef8-b0fe-23ff2b1162d1'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:45:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:49 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:49 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:49 devstack sudo[92589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:45:49 devstack sudo[92589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:49 devstack sudo[92589]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.292s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:49 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:45:49 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Deleted volume successfully. Nov 05 03:45:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c5ae1660-1719-4394-94fa-749bcc80b35d tempest-VolumeRetypeWithoutMigrationTest-1833575436 None] Lock "cinder-a1d9abdf-c8ba-4d4a-8fa7-97c5b9aef421-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Flow 'volume_create_manager' (abb2d125-3aef-4e84-8f22-4fcc70676fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9070946d-063f-4f47-868c-2b4f8fa46115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9070946d-063f-4f47-868c-2b4f8fa46115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2026084693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05da92f6-f78f-46b5-aa85-6e67f39bb090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2df41e2ffb4498c897eaed66e956ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:52Z,use_quota=True,user_id='4d921db3f3744d2ca7524c9421c462cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd01a813-b390-4a07-bf0c-307589e157d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd01a813-b390-4a07-bf0c-307589e157d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0d714e-48a9-4a86-8535-002eb9ce4397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0d714e-48a9-4a86-8535-002eb9ce4397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05da92f6-f78f-46b5-aa85-6e67f39bb090', 'volume_name': 'volume-05da92f6-f78f-46b5-aa85-6e67f39bb090', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e30969f3-f1f7-4e9a-a0f2-1603e029a8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e30969f3-f1f7-4e9a-a0f2-1603e029a8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4534b4-8bfe-4f76-a4dd-4a0ca87d49eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:51 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Volume 05da92f6-f78f-46b5-aa85-6e67f39bb090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05da92f6-f78f-46b5-aa85-6e67f39bb090', 'volume_size': 1} Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:45:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2026084693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05da92f6-f78f-46b5-aa85-6e67f39bb090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2df41e2ffb4498c897eaed66e956ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:45:52Z,use_quota=True,user_id='4d921db3f3744d2ca7524c9421c462cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Creating volume 05da92f6-f78f-46b5-aa85-6e67f39bb090 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:45:51 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:45:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-05da92f6-f78f-46b5-aa85-6e67f39bb090 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:51 devstack sudo[92620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-05da92f6-f78f-46b5-aa85-6e67f39bb090 1073741824 Nov 05 03:45:51 devstack sudo[92620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:52 devstack sudo[92620]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-05da92f6-f78f-46b5-aa85-6e67f39bb090 1073741824" returned: 0 in 0.919s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-05da92f6-f78f-46b5-aa85-6e67f39bb090 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:52 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-05da92f6-f78f-46b5-aa85-6e67f39bb090 Nov 05 03:45:52 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:53 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-05da92f6-f78f-46b5-aa85-6e67f39bb090" returned: 0 in 0.459s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:45:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4534b4-8bfe-4f76-a4dd-4a0ca87d49eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05da92f6-f78f-46b5-aa85-6e67f39bb090', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d0844b5-344e-490b-9db1-615955c16c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:45:53 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Volume volume-05da92f6-f78f-46b5-aa85-6e67f39bb090 (05da92f6-f78f-46b5-aa85-6e67f39bb090): created successfully Nov 05 03:45:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d0844b5-344e-490b-9db1-615955c16c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:45:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Flow 'volume_create_manager' (abb2d125-3aef-4e84-8f22-4fcc70676fee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:45:53 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-37aca873-0157-4018-bfe8-d9cdaea77930 tempest-AttachVolumeShelveTestJSON-157895211 None] Created volume successfully. Nov 05 03:45:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:45:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:45:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:45:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:45:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:45:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:45:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:45:58 devstack sudo[93096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:45:58 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:45:59 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root Nov 05 03:45:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.675s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:45:59 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:45:59 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:45:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 28 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:45:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:46:03 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=41,cinder:UPDATE=33,cinder:INSERT=16,cinder:DELETE=1 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:46:03 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=43,cinder:UPDATE=38,cinder:DELETE=5,cinder:INSERT=9 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Flow 'volume_create_manager' (7fb2e0c2-a579-4ac2-9fb5-817e296af82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d622d669-b74a-42da-9f73-7595390a160d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d622d669-b74a-42da-9f73-7595390a160d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2126709610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=815517d9-2be6-42d8-bb44-903edbb3022b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3804677b96f2476d94dd27c620032d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:05Z,use_quota=True,user_id='174783dff8b845e38a87f510b5ce3886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c6662f-8d1f-47fb-a1f3-e58618a8f458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6c6662f-8d1f-47fb-a1f3-e58618a8f458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a573f07b-e48d-43ea-93bc-fe99eeda2e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a573f07b-e48d-43ea-93bc-fe99eeda2e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '815517d9-2be6-42d8-bb44-903edbb3022b', 'volume_name': 'volume-815517d9-2be6-42d8-bb44-903edbb3022b', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e90d5b-48cb-46a1-b877-96cc85608066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92e90d5b-48cb-46a1-b877-96cc85608066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c96d04-2184-4477-a9be-45a8829cdf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:05 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Volume 815517d9-2be6-42d8-bb44-903edbb3022b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-815517d9-2be6-42d8-bb44-903edbb3022b', 'volume_size': 1} Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2126709610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=815517d9-2be6-42d8-bb44-903edbb3022b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3804677b96f2476d94dd27c620032d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:05Z,use_quota=True,user_id='174783dff8b845e38a87f510b5ce3886',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Creating volume 815517d9-2be6-42d8-bb44-903edbb3022b {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:46:05 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:46:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-815517d9-2be6-42d8-bb44-903edbb3022b 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:05 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-815517d9-2be6-42d8-bb44-903edbb3022b 1073741824 Nov 05 03:46:05 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:06 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-815517d9-2be6-42d8-bb44-903edbb3022b 1073741824" returned: 0 in 0.776s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-815517d9-2be6-42d8-bb44-903edbb3022b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:06 devstack sudo[93224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-815517d9-2be6-42d8-bb44-903edbb3022b Nov 05 03:46:06 devstack sudo[93224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:06 devstack sudo[93224]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-815517d9-2be6-42d8-bb44-903edbb3022b" returned: 0 in 0.533s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:46:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c96d04-2184-4477-a9be-45a8829cdf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-815517d9-2be6-42d8-bb44-903edbb3022b', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f286fc-c2a9-41c5-9959-43834e93c736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:07 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Volume volume-815517d9-2be6-42d8-bb44-903edbb3022b (815517d9-2be6-42d8-bb44-903edbb3022b): created successfully Nov 05 03:46:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f286fc-c2a9-41c5-9959-43834e93c736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Flow 'volume_create_manager' (7fb2e0c2-a579-4ac2-9fb5-817e296af82c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:07 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5053386a-1331-4c3c-9121-b6e36afe2e0a tempest-VolumesServicesTestJSON-2012752543 None] Created volume successfully. Nov 05 03:46:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bb137c90-3f0a-4b2d-b8a3-99ccdb89e2ff tempest-VolumesServicesTestJSON-2012752543 None] Acquiring lock "cinder-815517d9-2be6-42d8-bb44-903edbb3022b-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bb137c90-3f0a-4b2d-b8a3-99ccdb89e2ff tempest-VolumesServicesTestJSON-2012752543 None] Lock "cinder-815517d9-2be6-42d8-bb44-903edbb3022b-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bb137c90-3f0a-4b2d-b8a3-99ccdb89e2ff tempest-VolumesServicesTestJSON-2012752543 None] Acquiring lock "cinder-quobyte-815517d9-2be6-42d8-bb44-903edbb3022b" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bb137c90-3f0a-4b2d-b8a3-99ccdb89e2ff tempest-VolumesServicesTestJSON-2012752543 None] Lock "cinder-quobyte-815517d9-2be6-42d8-bb44-903edbb3022b" acquired by "delete_volume" :: waited 0.026s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:08 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03941d0-6afa-4499-b12c-a59b1c410f79]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bb137c90-3f0a-4b2d-b8a3-99ccdb89e2ff tempest-VolumesServicesTestJSON-2012752543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-815517d9-2be6-42d8-bb44-903edbb3022b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:08 devstack sudo[93231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-815517d9-2be6-42d8-bb44-903edbb3022b Nov 05 03:46:08 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:09 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bb137c90-3f0a-4b2d-b8a3-99ccdb89e2ff tempest-VolumesServicesTestJSON-2012752543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-815517d9-2be6-42d8-bb44-903edbb3022b" returned: 0 in 0.609s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bb137c90-3f0a-4b2d-b8a3-99ccdb89e2ff tempest-VolumesServicesTestJSON-2012752543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-815517d9-2be6-42d8-bb44-903edbb3022b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:09 devstack sudo[93239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-815517d9-2be6-42d8-bb44-903edbb3022b Nov 05 03:46:09 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:09 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bb137c90-3f0a-4b2d-b8a3-99ccdb89e2ff tempest-VolumesServicesTestJSON-2012752543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-815517d9-2be6-42d8-bb44-903edbb3022b" returned: 0 in 0.470s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bb137c90-3f0a-4b2d-b8a3-99ccdb89e2ff tempest-VolumesServicesTestJSON-2012752543 None] Lock "cinder-quobyte-815517d9-2be6-42d8-bb44-903edbb3022b" released by "delete_volume" :: held 1.270s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:09 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-bb137c90-3f0a-4b2d-b8a3-99ccdb89e2ff tempest-VolumesServicesTestJSON-2012752543 None] Created reservations ['b2988728-c508-41cb-b161-4238867a6df2', '7e847c31-870b-41ed-90b9-10c5b1d008d8', '4e04ebbd-497e-4a8a-9566-8eee2fc4f68e', '0765c797-7658-48d3-a645-53b79e403304'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:46:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bb137c90-3f0a-4b2d-b8a3-99ccdb89e2ff tempest-VolumesServicesTestJSON-2012752543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bb137c90-3f0a-4b2d-b8a3-99ccdb89e2ff tempest-VolumesServicesTestJSON-2012752543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-bb137c90-3f0a-4b2d-b8a3-99ccdb89e2ff tempest-VolumesServicesTestJSON-2012752543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-bb137c90-3f0a-4b2d-b8a3-99ccdb89e2ff tempest-VolumesServicesTestJSON-2012752543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bb137c90-3f0a-4b2d-b8a3-99ccdb89e2ff tempest-VolumesServicesTestJSON-2012752543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bb137c90-3f0a-4b2d-b8a3-99ccdb89e2ff tempest-VolumesServicesTestJSON-2012752543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:10 devstack sudo[93244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:46:10 devstack sudo[93244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:11 devstack sudo[93244]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bb137c90-3f0a-4b2d-b8a3-99ccdb89e2ff tempest-VolumesServicesTestJSON-2012752543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 1.028s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:11 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-bb137c90-3f0a-4b2d-b8a3-99ccdb89e2ff tempest-VolumesServicesTestJSON-2012752543 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:46:11 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-bb137c90-3f0a-4b2d-b8a3-99ccdb89e2ff tempest-VolumesServicesTestJSON-2012752543 None] Deleted volume successfully. Nov 05 03:46:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bb137c90-3f0a-4b2d-b8a3-99ccdb89e2ff tempest-VolumesServicesTestJSON-2012752543 None] Lock "cinder-815517d9-2be6-42d8-bb44-903edbb3022b-delete_volume" released by "delete_volume" :: held 2.976s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-e7fe44c1-3d6d-425c-aed8-de16fe04511a req-f10dbaa2-5138-451b-9cb1-84a225fe79d9 tempest-AttachVolumeShelveTestJSON-157895211 None] No connector for attachment ba0da360-dfcf-40be-9dd3-880963f697a9; skipping storage backend terminate_connection call. {{(pid=87109) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5031}} Nov 05 03:46:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-e7fe44c1-3d6d-425c-aed8-de16fe04511a req-f10dbaa2-5138-451b-9cb1-84a225fe79d9 tempest-AttachVolumeShelveTestJSON-157895211 None] Deleting attachment ba0da360-dfcf-40be-9dd3-880963f697a9. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:46:15 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-fa132848-c742-40ce-a19a-ba0ff4d34ced req-4b6c4bc7-cbe2-4dea-b2ef-b8b9cc013509 tempest-ServerActionsTestOtherA-151106859 None] Terminate volume connection completed successfully. Nov 05 03:46:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-fa132848-c742-40ce-a19a-ba0ff4d34ced req-4b6c4bc7-cbe2-4dea-b2ef-b8b9cc013509 tempest-ServerActionsTestOtherA-151106859 None] Deleting attachment 249c87bd-c756-44bc-ae8c-a106cb4e6c44. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:46:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-fa132848-c742-40ce-a19a-ba0ff4d34ced req-260b53e0-3642-4940-b9ea-d0fe4ecf0efa tempest-ServerActionsTestOtherA-151106859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-fa132848-c742-40ce-a19a-ba0ff4d34ced req-260b53e0-3642-4940-b9ea-d0fe4ecf0efa tempest-ServerActionsTestOtherA-151106859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-fa132848-c742-40ce-a19a-ba0ff4d34ced req-260b53e0-3642-4940-b9ea-d0fe4ecf0efa tempest-ServerActionsTestOtherA-151106859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-fa132848-c742-40ce-a19a-ba0ff4d34ced req-260b53e0-3642-4940-b9ea-d0fe4ecf0efa tempest-ServerActionsTestOtherA-151106859 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3f47790-6155-41d6-8bf2-0bea99fcdc54', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:46:18 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-fa132848-c742-40ce-a19a-ba0ff4d34ced req-260b53e0-3642-4940-b9ea-d0fe4ecf0efa tempest-ServerActionsTestOtherA-151106859 None] attachment_update completed successfully. Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Flow 'volume_create_manager' (d83b7b8f-a493-45b2-a0ed-1828b84d7753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c81bbe-2c96-4a71-a24b-eeb6d56e573d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c81bbe-2c96-4a71-a24b-eeb6d56e573d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2080877798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb9ab37-41a9-4569-b755-d1889c5d36eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='628c7691c1c243958cd38f3564251286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:22Z,use_quota=True,user_id='8c80d14e550a48e380de1611aa3d1866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7656cb-78a6-40b2-87d1-9ab212f9a5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f7656cb-78a6-40b2-87d1-9ab212f9a5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee48eac2-207c-449b-8fbd-7503cd21005f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee48eac2-207c-449b-8fbd-7503cd21005f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eb9ab37-41a9-4569-b755-d1889c5d36eb', 'volume_name': 'volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc42b7a9-cb89-4c77-abf4-3d3f7fa854ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc42b7a9-cb89-4c77-abf4-3d3f7fa854ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714c4c33-be58-4a25-9501-e866f2f1f2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:22 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Volume 7eb9ab37-41a9-4569-b755-d1889c5d36eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb', 'volume_size': 1} Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2080877798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eb9ab37-41a9-4569-b755-d1889c5d36eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='628c7691c1c243958cd38f3564251286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:22Z,use_quota=True,user_id='8c80d14e550a48e380de1611aa3d1866',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Creating volume 7eb9ab37-41a9-4569-b755-d1889c5d36eb {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:46:22 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:46:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:22 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb 1073741824 Nov 05 03:46:22 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:23 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb 1073741824" returned: 0 in 0.699s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:23 devstack sudo[93840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb Nov 05 03:46:23 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:23 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb" returned: 0 in 0.361s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:46:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714c4c33-be58-4a25-9501-e866f2f1f2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1cfdc5-21e3-4fef-98a5-97ab529f8203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:23 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Volume volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb (7eb9ab37-41a9-4569-b755-d1889c5d36eb): created successfully Nov 05 03:46:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1cfdc5-21e3-4fef-98a5-97ab529f8203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Flow 'volume_create_manager' (d83b7b8f-a493-45b2-a0ed-1828b84d7753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:23 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-acf7643d-61e0-46f4-aec6-dce65f1e7f64 tempest-SnapshotMetadataTestJSON-480061714 None] Created volume successfully. Nov 05 03:46:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2c3d9ae2-2a40-4f66-bfff-dc3b14776fc6 tempest-SnapshotMetadataTestJSON-480061714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2c3d9ae2-2a40-4f66-bfff-dc3b14776fc6 tempest-SnapshotMetadataTestJSON-480061714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-2c3d9ae2-2a40-4f66-bfff-dc3b14776fc6 tempest-SnapshotMetadataTestJSON-480061714 None] Creating offline snapshot ce289b1f-8588-42ae-8d75-da2b33b94536 of volume 7eb9ab37-41a9-4569-b755-d1889c5d36eb {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:46:25 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2623a36f-e8c5-4513-afef-861a1248d954]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2c3d9ae2-2a40-4f66-bfff-dc3b14776fc6 tempest-SnapshotMetadataTestJSON-480061714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:25 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb Nov 05 03:46:25 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:25 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2c3d9ae2-2a40-4f66-bfff-dc3b14776fc6 tempest-SnapshotMetadataTestJSON-480061714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb" returned: 0 in 0.541s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2c3d9ae2-2a40-4f66-bfff-dc3b14776fc6 tempest-SnapshotMetadataTestJSON-480061714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.ce289b1f-8588-42ae-8d75-da2b33b94536 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:25 devstack sudo[93849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.ce289b1f-8588-42ae-8d75-da2b33b94536 1G Nov 05 03:46:25 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:26 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2c3d9ae2-2a40-4f66-bfff-dc3b14776fc6 tempest-SnapshotMetadataTestJSON-480061714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.ce289b1f-8588-42ae-8d75-da2b33b94536 1G" returned: 0 in 0.625s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2c3d9ae2-2a40-4f66-bfff-dc3b14776fc6 tempest-SnapshotMetadataTestJSON-480061714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.ce289b1f-8588-42ae-8d75-da2b33b94536 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:26 devstack sudo[93860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.ce289b1f-8588-42ae-8d75-da2b33b94536 Nov 05 03:46:26 devstack sudo[93860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:26 devstack sudo[93860]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2c3d9ae2-2a40-4f66-bfff-dc3b14776fc6 tempest-SnapshotMetadataTestJSON-480061714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.ce289b1f-8588-42ae-8d75-da2b33b94536" returned: 0 in 0.495s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:26 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-2c3d9ae2-2a40-4f66-bfff-dc3b14776fc6 tempest-SnapshotMetadataTestJSON-480061714 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.ce289b1f-8588-42ae-8d75-da2b33b94536 is being set with open permissions: ugo+rw Nov 05 03:46:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2c3d9ae2-2a40-4f66-bfff-dc3b14776fc6 tempest-SnapshotMetadataTestJSON-480061714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.ce289b1f-8588-42ae-8d75-da2b33b94536 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:26 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.ce289b1f-8588-42ae-8d75-da2b33b94536 Nov 05 03:46:26 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:27 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2c3d9ae2-2a40-4f66-bfff-dc3b14776fc6 tempest-SnapshotMetadataTestJSON-480061714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.ce289b1f-8588-42ae-8d75-da2b33b94536" returned: 0 in 0.406s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2c3d9ae2-2a40-4f66-bfff-dc3b14776fc6 tempest-SnapshotMetadataTestJSON-480061714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:27 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.info Nov 05 03:46:27 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:27 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2c3d9ae2-2a40-4f66-bfff-dc3b14776fc6 tempest-SnapshotMetadataTestJSON-480061714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.info" returned: 0 in 0.544s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:27 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-2c3d9ae2-2a40-4f66-bfff-dc3b14776fc6 tempest-SnapshotMetadataTestJSON-480061714 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.info is being set with open permissions: ugo+rw Nov 05 03:46:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2c3d9ae2-2a40-4f66-bfff-dc3b14776fc6 tempest-SnapshotMetadataTestJSON-480061714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:27 devstack sudo[93897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.info Nov 05 03:46:27 devstack sudo[93897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:28 devstack sudo[93897]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2c3d9ae2-2a40-4f66-bfff-dc3b14776fc6 tempest-SnapshotMetadataTestJSON-480061714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.info" returned: 0 in 0.436s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2c3d9ae2-2a40-4f66-bfff-dc3b14776fc6 tempest-SnapshotMetadataTestJSON-480061714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.234s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:28 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-2c3d9ae2-2a40-4f66-bfff-dc3b14776fc6 tempest-SnapshotMetadataTestJSON-480061714 None] Create snapshot completed successfully Nov 05 03:46:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] Acquiring lock "cinder-ce289b1f-8588-42ae-8d75-da2b33b94536-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] Lock "cinder-ce289b1f-8588-42ae-8d75-da2b33b94536-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] Acquiring lock "cinder-quobyte-7eb9ab37-41a9-4569-b755-d1889c5d36eb" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] Lock "cinder-quobyte-7eb9ab37-41a9-4569-b755-d1889c5d36eb" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] Acquiring lock "cinder-quobyte-ce289b1f-8588-42ae-8d75-da2b33b94536" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] Lock "cinder-quobyte-ce289b1f-8588-42ae-8d75-da2b33b94536" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] Deleting offline snapshot ce289b1f-8588-42ae-8d75-da2b33b94536 of volume 7eb9ab37-41a9-4569-b755-d1889c5d36eb {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:46:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] snapshot_file for this snap is: volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.ce289b1f-8588-42ae-8d75-da2b33b94536 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:46:31 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f36faa-02aa-48df-a747-4509ffd63b72]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.ce289b1f-8588-42ae-8d75-da2b33b94536 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:31 devstack sudo[93962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.ce289b1f-8588-42ae-8d75-da2b33b94536 Nov 05 03:46:31 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:31 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.ce289b1f-8588-42ae-8d75-da2b33b94536" returned: 0 in 0.599s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:46:31 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d82e52f-3144-47fe-8628-27dd62174e78]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:32 devstack sudo[93977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb Nov 05 03:46:32 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:32 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb" returned: 0 in 0.706s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.ce289b1f-8588-42ae-8d75-da2b33b94536 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:32 devstack sudo[93985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.ce289b1f-8588-42ae-8d75-da2b33b94536 Nov 05 03:46:32 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:33 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.ce289b1f-8588-42ae-8d75-da2b33b94536" returned: 0 in 0.963s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.ce289b1f-8588-42ae-8d75-da2b33b94536 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:33 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.ce289b1f-8588-42ae-8d75-da2b33b94536 Nov 05 03:46:33 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:33 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Flow 'volume_create_manager' (ebf78aac-40a5-418f-84a4-8a514d02a55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d91b0cb-ee6d-426e-a285-12f97f3d12ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d91b0cb-ee6d-426e-a285-12f97f3d12ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1777571599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f134074-d8f8-460e-8a9f-d5327ffac8d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33a759785d9444da8fd65bd9a0341878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:34Z,use_quota=True,user_id='30c9e04aa5394e5792fb0138b08012d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0622773-8bad-4e8f-acc7-897b68295411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0622773-8bad-4e8f-acc7-897b68295411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df0ac35-b30e-479a-a4e6-593c305e3271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df0ac35-b30e-479a-a4e6-593c305e3271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f134074-d8f8-460e-8a9f-d5327ffac8d7', 'volume_name': 'volume-4f134074-d8f8-460e-8a9f-d5327ffac8d7', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:34 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cc072d-fbfe-444b-b48a-2f22c6278ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73cc072d-fbfe-444b-b48a-2f22c6278ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf3ca5e-703b-4ece-b575-f5f592000559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:34 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Volume 4f134074-d8f8-460e-8a9f-d5327ffac8d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f134074-d8f8-460e-8a9f-d5327ffac8d7', 'volume_size': 1} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1777571599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f134074-d8f8-460e-8a9f-d5327ffac8d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33a759785d9444da8fd65bd9a0341878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:34Z,use_quota=True,user_id='30c9e04aa5394e5792fb0138b08012d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Creating volume 4f134074-d8f8-460e-8a9f-d5327ffac8d7 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:46:34 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4f134074-d8f8-460e-8a9f-d5327ffac8d7 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb.ce289b1f-8588-42ae-8d75-da2b33b94536" returned: 0 in 0.566s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:34 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4f134074-d8f8-460e-8a9f-d5327ffac8d7 1073741824 Nov 05 03:46:34 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] Lock "cinder-quobyte-ce289b1f-8588-42ae-8d75-da2b33b94536" released by "_delete_snapshot" :: held 3.028s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] Lock "cinder-quobyte-7eb9ab37-41a9-4569-b755-d1889c5d36eb" released by "delete_snapshot" :: held 3.058s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:34 devstack cinder-volume[87109]: WARNING cinder.quota [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] Created reservations ['524af86e-4b80-4c04-a40e-baa9ca0a1858', '418b8d73-ee0a-47c3-844e-f60209ceb579', '28b8fbba-9950-4bf4-899d-74b5227edcb4', '4557d517-cf9a-4da3-97cd-5d35fb19ae83'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:46:34 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] Delete snapshot completed successfully. Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ff6877d8-5237-49a8-a293-c3c71b3ba490 tempest-SnapshotMetadataTestJSON-480061714 None] Lock "cinder-ce289b1f-8588-42ae-8d75-da2b33b94536-delete_snapshot" released by "delete_snapshot" :: held 3.313s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1772cb6c-f175-435c-95d5-faf722752277 tempest-SnapshotMetadataTestJSON-480061714 None] Acquiring lock "cinder-7eb9ab37-41a9-4569-b755-d1889c5d36eb-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1772cb6c-f175-435c-95d5-faf722752277 tempest-SnapshotMetadataTestJSON-480061714 None] Lock "cinder-7eb9ab37-41a9-4569-b755-d1889c5d36eb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1772cb6c-f175-435c-95d5-faf722752277 tempest-SnapshotMetadataTestJSON-480061714 None] Acquiring lock "cinder-quobyte-7eb9ab37-41a9-4569-b755-d1889c5d36eb" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:34 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1772cb6c-f175-435c-95d5-faf722752277 tempest-SnapshotMetadataTestJSON-480061714 None] Lock "cinder-quobyte-7eb9ab37-41a9-4569-b755-d1889c5d36eb" acquired by "delete_volume" :: waited 0.058s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4f134074-d8f8-460e-8a9f-d5327ffac8d7 1073741824" returned: 0 in 0.822s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c987ab5-3cfc-4b9a-83ce-35595a9236c2]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1772cb6c-f175-435c-95d5-faf722752277 tempest-SnapshotMetadataTestJSON-480061714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4f134074-d8f8-460e-8a9f-d5327ffac8d7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:35 devstack sudo[94002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4f134074-d8f8-460e-8a9f-d5327ffac8d7 Nov 05 03:46:35 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:35 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb Nov 05 03:46:35 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:35 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4f134074-d8f8-460e-8a9f-d5327ffac8d7" returned: 0 in 0.348s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:46:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf3ca5e-703b-4ece-b575-f5f592000559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f134074-d8f8-460e-8a9f-d5327ffac8d7', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751e6bc4-f156-4a51-95f0-4dd1910978b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:35 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Volume volume-4f134074-d8f8-460e-8a9f-d5327ffac8d7 (4f134074-d8f8-460e-8a9f-d5327ffac8d7): created successfully Nov 05 03:46:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751e6bc4-f156-4a51-95f0-4dd1910978b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Flow 'volume_create_manager' (ebf78aac-40a5-418f-84a4-8a514d02a55f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:35 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1772cb6c-f175-435c-95d5-faf722752277 tempest-SnapshotMetadataTestJSON-480061714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb" returned: 0 in 0.471s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1772cb6c-f175-435c-95d5-faf722752277 tempest-SnapshotMetadataTestJSON-480061714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:35 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-56b10a8c-96af-4f01-986e-e725976bf409 tempest-AttachVolumeTestJSON-795486824 None] Created volume successfully. Nov 05 03:46:35 devstack sudo[94009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb Nov 05 03:46:35 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:35 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1772cb6c-f175-435c-95d5-faf722752277 tempest-SnapshotMetadataTestJSON-480061714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eb9ab37-41a9-4569-b755-d1889c5d36eb" returned: 0 in 0.290s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1772cb6c-f175-435c-95d5-faf722752277 tempest-SnapshotMetadataTestJSON-480061714 None] Lock "cinder-quobyte-7eb9ab37-41a9-4569-b755-d1889c5d36eb" released by "delete_volume" :: held 0.858s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:35 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-1772cb6c-f175-435c-95d5-faf722752277 tempest-SnapshotMetadataTestJSON-480061714 None] Created reservations ['4a88c2bd-f577-4d52-b01d-2b26f60c1fb7', 'e18d326b-6963-45cf-8455-4ea6a3b0a27e', '188702b5-5c22-4594-b295-7fa8c4cca12d', '3278b087-17b0-4f71-877b-54ea5fcf08f4'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:46:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1772cb6c-f175-435c-95d5-faf722752277 tempest-SnapshotMetadataTestJSON-480061714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1772cb6c-f175-435c-95d5-faf722752277 tempest-SnapshotMetadataTestJSON-480061714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1772cb6c-f175-435c-95d5-faf722752277 tempest-SnapshotMetadataTestJSON-480061714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1772cb6c-f175-435c-95d5-faf722752277 tempest-SnapshotMetadataTestJSON-480061714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1772cb6c-f175-435c-95d5-faf722752277 tempest-SnapshotMetadataTestJSON-480061714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1772cb6c-f175-435c-95d5-faf722752277 tempest-SnapshotMetadataTestJSON-480061714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:35 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:46:35 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:36 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1772cb6c-f175-435c-95d5-faf722752277 tempest-SnapshotMetadataTestJSON-480061714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.404s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:36 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-1772cb6c-f175-435c-95d5-faf722752277 tempest-SnapshotMetadataTestJSON-480061714 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:46:36 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-1772cb6c-f175-435c-95d5-faf722752277 tempest-SnapshotMetadataTestJSON-480061714 None] Deleted volume successfully. Nov 05 03:46:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1772cb6c-f175-435c-95d5-faf722752277 tempest-SnapshotMetadataTestJSON-480061714 None] Lock "cinder-7eb9ab37-41a9-4569-b755-d1889c5d36eb-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-ac92b659-3143-4184-8f64-2cc76e6ad94b req-4c501b8f-5f5f-4068-a38c-1fee43060c4c tempest-AttachVolumeTestJSON-795486824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-ac92b659-3143-4184-8f64-2cc76e6ad94b req-4c501b8f-5f5f-4068-a38c-1fee43060c4c tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-ac92b659-3143-4184-8f64-2cc76e6ad94b req-4c501b8f-5f5f-4068-a38c-1fee43060c4c tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-ac92b659-3143-4184-8f64-2cc76e6ad94b req-4c501b8f-5f5f-4068-a38c-1fee43060c4c tempest-AttachVolumeTestJSON-795486824 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-4f134074-d8f8-460e-8a9f-d5327ffac8d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b738e5a9-ca90-4dd1-bede-014693c1406e', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:46:37 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-ac92b659-3143-4184-8f64-2cc76e6ad94b req-4c501b8f-5f5f-4068-a38c-1fee43060c4c tempest-AttachVolumeTestJSON-795486824 None] attachment_update completed successfully. Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Flow 'volume_create_manager' (62bc8d57-7252-4b5d-9626-c0d5e1c0814e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa6a272-3c23-4b4a-bea5-34b78ce395b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa6a272-3c23-4b4a-bea5-34b78ce395b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-51691535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed7d327-1769-4bd2-8582-53074af0040a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33a759785d9444da8fd65bd9a0341878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:40Z,use_quota=True,user_id='30c9e04aa5394e5792fb0138b08012d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310544ae-537b-482b-badd-5061772481ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310544ae-537b-482b-badd-5061772481ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a795785d-44f8-4887-b405-09c9c8d68c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a795785d-44f8-4887-b405-09c9c8d68c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ed7d327-1769-4bd2-8582-53074af0040a', 'volume_name': 'volume-8ed7d327-1769-4bd2-8582-53074af0040a', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875790cc-cb89-4dc8-8839-2ce22ec09800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875790cc-cb89-4dc8-8839-2ce22ec09800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521f89ee-328f-40c3-b4d8-a72a1303e1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:40 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Volume 8ed7d327-1769-4bd2-8582-53074af0040a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ed7d327-1769-4bd2-8582-53074af0040a', 'volume_size': 1} Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-51691535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ed7d327-1769-4bd2-8582-53074af0040a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33a759785d9444da8fd65bd9a0341878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:40Z,use_quota=True,user_id='30c9e04aa5394e5792fb0138b08012d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Creating volume 8ed7d327-1769-4bd2-8582-53074af0040a {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:46:40 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:46:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8ed7d327-1769-4bd2-8582-53074af0040a 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:40 devstack sudo[94073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8ed7d327-1769-4bd2-8582-53074af0040a 1073741824 Nov 05 03:46:40 devstack sudo[94073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:41 devstack sudo[94073]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8ed7d327-1769-4bd2-8582-53074af0040a 1073741824" returned: 0 in 0.537s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8ed7d327-1769-4bd2-8582-53074af0040a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:41 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8ed7d327-1769-4bd2-8582-53074af0040a Nov 05 03:46:41 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:41 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8ed7d327-1769-4bd2-8582-53074af0040a" returned: 0 in 0.276s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:41 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:46:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (521f89ee-328f-40c3-b4d8-a72a1303e1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ed7d327-1769-4bd2-8582-53074af0040a', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aafbe24-224f-4552-923c-e89b1b57f88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:41 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Volume volume-8ed7d327-1769-4bd2-8582-53074af0040a (8ed7d327-1769-4bd2-8582-53074af0040a): created successfully Nov 05 03:46:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aafbe24-224f-4552-923c-e89b1b57f88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Flow 'volume_create_manager' (62bc8d57-7252-4b5d-9626-c0d5e1c0814e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:41 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-e94ee208-592b-4cf0-bf32-efd0fde7df2e tempest-AttachVolumeTestJSON-795486824 None] Created volume successfully. Nov 05 03:46:41 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Flow 'volume_create_manager' (e7c3acff-ff5c-44ff-978f-1cb271dcf5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e116643f-dd03-4893-b504-bd3bddc5a79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e116643f-dd03-4893-b504-bd3bddc5a79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-755755914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eaff1d8-775d-4fcf-b02d-1250be7bca14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78f470b944840c183be60bd2fa215a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:42Z,use_quota=True,user_id='0b5a68a2eebf4520985ddac4adb09204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1842333e-c1db-49cd-a609-e7f54b8a0b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1842333e-c1db-49cd-a609-e7f54b8a0b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683d3c24-d599-4c7d-b1b4-251a2b14df15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683d3c24-d599-4c7d-b1b4-251a2b14df15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eaff1d8-775d-4fcf-b02d-1250be7bca14', 'volume_name': 'volume-7eaff1d8-775d-4fcf-b02d-1250be7bca14', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5008c252-3740-4d1b-aab9-d7c076562db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5008c252-3740-4d1b-aab9-d7c076562db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1dc19f-2441-4a20-a56c-590782dd64b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:42 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Volume 7eaff1d8-775d-4fcf-b02d-1250be7bca14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eaff1d8-775d-4fcf-b02d-1250be7bca14', 'volume_size': 1} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-755755914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eaff1d8-775d-4fcf-b02d-1250be7bca14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b78f470b944840c183be60bd2fa215a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:42Z,use_quota=True,user_id='0b5a68a2eebf4520985ddac4adb09204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Creating volume 7eaff1d8-775d-4fcf-b02d-1250be7bca14 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:46:42 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eaff1d8-775d-4fcf-b02d-1250be7bca14 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:42 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eaff1d8-775d-4fcf-b02d-1250be7bca14 1073741824 Nov 05 03:46:42 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:42 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eaff1d8-775d-4fcf-b02d-1250be7bca14 1073741824" returned: 0 in 0.512s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eaff1d8-775d-4fcf-b02d-1250be7bca14 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:42 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eaff1d8-775d-4fcf-b02d-1250be7bca14 Nov 05 03:46:42 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:42 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eaff1d8-775d-4fcf-b02d-1250be7bca14" returned: 0 in 0.341s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1dc19f-2441-4a20-a56c-590782dd64b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eaff1d8-775d-4fcf-b02d-1250be7bca14', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:43 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418456c1-fdfa-425e-9bde-acc515acba16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:43 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Volume volume-7eaff1d8-775d-4fcf-b02d-1250be7bca14 (7eaff1d8-775d-4fcf-b02d-1250be7bca14): created successfully Nov 05 03:46:43 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418456c1-fdfa-425e-9bde-acc515acba16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:43 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Flow 'volume_create_manager' (e7c3acff-ff5c-44ff-978f-1cb271dcf5a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:43 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-13e2f336-4157-4775-a35a-4a0f5404c72d tempest-AbsoluteLimitsTests-1241959950 None] Created volume successfully. Nov 05 03:46:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-fa7e3501-86fa-49e0-88e1-d2605e77eee4 req-9f7bb635-244e-43a3-a44d-d1114ff7e6cd tempest-AttachVolumeTestJSON-795486824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-fa7e3501-86fa-49e0-88e1-d2605e77eee4 req-9f7bb635-244e-43a3-a44d-d1114ff7e6cd tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-fa7e3501-86fa-49e0-88e1-d2605e77eee4 req-9f7bb635-244e-43a3-a44d-d1114ff7e6cd tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:43 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-fa7e3501-86fa-49e0-88e1-d2605e77eee4 req-9f7bb635-244e-43a3-a44d-d1114ff7e6cd tempest-AttachVolumeTestJSON-795486824 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-8ed7d327-1769-4bd2-8582-53074af0040a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11c37bc5-5d10-4b2e-a907-8adf36b24de4', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:46:43 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-fa7e3501-86fa-49e0-88e1-d2605e77eee4 req-9f7bb635-244e-43a3-a44d-d1114ff7e6cd tempest-AttachVolumeTestJSON-795486824 None] attachment_update completed successfully. Nov 05 03:46:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f761b5f4-aa48-4a94-b444-f73a6d03c0fa tempest-AbsoluteLimitsTests-1241959950 None] Acquiring lock "cinder-7eaff1d8-775d-4fcf-b02d-1250be7bca14-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f761b5f4-aa48-4a94-b444-f73a6d03c0fa tempest-AbsoluteLimitsTests-1241959950 None] Lock "cinder-7eaff1d8-775d-4fcf-b02d-1250be7bca14-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f761b5f4-aa48-4a94-b444-f73a6d03c0fa tempest-AbsoluteLimitsTests-1241959950 None] Acquiring lock "cinder-quobyte-7eaff1d8-775d-4fcf-b02d-1250be7bca14" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f761b5f4-aa48-4a94-b444-f73a6d03c0fa tempest-AbsoluteLimitsTests-1241959950 None] Lock "cinder-quobyte-7eaff1d8-775d-4fcf-b02d-1250be7bca14" acquired by "delete_volume" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:44 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[a010c32f-bd22-44d1-a863-5242666a75d3]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f761b5f4-aa48-4a94-b444-f73a6d03c0fa tempest-AbsoluteLimitsTests-1241959950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eaff1d8-775d-4fcf-b02d-1250be7bca14 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:44 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eaff1d8-775d-4fcf-b02d-1250be7bca14 Nov 05 03:46:44 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:44 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f761b5f4-aa48-4a94-b444-f73a6d03c0fa tempest-AbsoluteLimitsTests-1241959950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eaff1d8-775d-4fcf-b02d-1250be7bca14" returned: 0 in 0.434s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f761b5f4-aa48-4a94-b444-f73a6d03c0fa tempest-AbsoluteLimitsTests-1241959950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eaff1d8-775d-4fcf-b02d-1250be7bca14 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:44 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eaff1d8-775d-4fcf-b02d-1250be7bca14 Nov 05 03:46:44 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:45 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-48eae936-0deb-4eaa-a3d2-5d01d61eea4b req-b2c2210e-acbd-4bc6-8f45-ec79608d0d3b tempest-AttachVolumeTestJSON-795486824 None] Terminate volume connection completed successfully. Nov 05 03:46:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-48eae936-0deb-4eaa-a3d2-5d01d61eea4b req-b2c2210e-acbd-4bc6-8f45-ec79608d0d3b tempest-AttachVolumeTestJSON-795486824 None] Deleting attachment b738e5a9-ca90-4dd1-bede-014693c1406e. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:46:45 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f761b5f4-aa48-4a94-b444-f73a6d03c0fa tempest-AbsoluteLimitsTests-1241959950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7eaff1d8-775d-4fcf-b02d-1250be7bca14" returned: 0 in 0.293s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f761b5f4-aa48-4a94-b444-f73a6d03c0fa tempest-AbsoluteLimitsTests-1241959950 None] Lock "cinder-quobyte-7eaff1d8-775d-4fcf-b02d-1250be7bca14" released by "delete_volume" :: held 0.788s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:45 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-f761b5f4-aa48-4a94-b444-f73a6d03c0fa tempest-AbsoluteLimitsTests-1241959950 None] Created reservations ['2215e210-bfa3-44f8-8ebd-36e3d5c81b63', '18f4fcfd-4552-452f-9ae1-c3769aa18073', '4e199cd5-33b9-43ed-8763-e832556c8e5c', 'ba49e257-217a-47ed-b762-cbf347d2cdbf'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:46:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f761b5f4-aa48-4a94-b444-f73a6d03c0fa tempest-AbsoluteLimitsTests-1241959950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f761b5f4-aa48-4a94-b444-f73a6d03c0fa tempest-AbsoluteLimitsTests-1241959950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:45 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f761b5f4-aa48-4a94-b444-f73a6d03c0fa tempest-AbsoluteLimitsTests-1241959950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:45 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f761b5f4-aa48-4a94-b444-f73a6d03c0fa tempest-AbsoluteLimitsTests-1241959950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f761b5f4-aa48-4a94-b444-f73a6d03c0fa tempest-AbsoluteLimitsTests-1241959950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f761b5f4-aa48-4a94-b444-f73a6d03c0fa tempest-AbsoluteLimitsTests-1241959950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:45 devstack sudo[94120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:46:45 devstack sudo[94120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:45 devstack sudo[94120]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f761b5f4-aa48-4a94-b444-f73a6d03c0fa tempest-AbsoluteLimitsTests-1241959950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.261s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:45 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-f761b5f4-aa48-4a94-b444-f73a6d03c0fa tempest-AbsoluteLimitsTests-1241959950 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:46:45 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f761b5f4-aa48-4a94-b444-f73a6d03c0fa tempest-AbsoluteLimitsTests-1241959950 None] Deleted volume successfully. Nov 05 03:46:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f761b5f4-aa48-4a94-b444-f73a6d03c0fa tempest-AbsoluteLimitsTests-1241959950 None] Lock "cinder-7eaff1d8-775d-4fcf-b02d-1250be7bca14-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:46 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-82f92c4f-dcfd-4bde-9e8d-40810f00e4bc req-baa08da1-d94e-4878-8236-690400a782c5 tempest-AttachVolumeTestJSON-795486824 None] Terminate volume connection completed successfully. Nov 05 03:46:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-82f92c4f-dcfd-4bde-9e8d-40810f00e4bc req-baa08da1-d94e-4878-8236-690400a782c5 tempest-AttachVolumeTestJSON-795486824 None] Deleting attachment 11c37bc5-5d10-4b2e-a907-8adf36b24de4. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:46:53 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-e860d9e1-8ab8-458a-9d29-2b68b4ff394e tempest-ServerActionsTestOtherA-151106859 None] Terminate volume connection completed successfully. Nov 05 03:46:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-e860d9e1-8ab8-458a-9d29-2b68b4ff394e tempest-ServerActionsTestOtherA-151106859 None] Deleting attachment f3f47790-6155-41d6-8bf2-0bea99fcdc54. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:46:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a9f597b7-fc2a-42ec-b06e-e9d7da6dd0d8 tempest-AttachVolumeTestJSON-795486824 None] Acquiring lock "cinder-8ed7d327-1769-4bd2-8582-53074af0040a-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a9f597b7-fc2a-42ec-b06e-e9d7da6dd0d8 tempest-AttachVolumeTestJSON-795486824 None] Lock "cinder-8ed7d327-1769-4bd2-8582-53074af0040a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a9f597b7-fc2a-42ec-b06e-e9d7da6dd0d8 tempest-AttachVolumeTestJSON-795486824 None] Acquiring lock "cinder-quobyte-8ed7d327-1769-4bd2-8582-53074af0040a" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a9f597b7-fc2a-42ec-b06e-e9d7da6dd0d8 tempest-AttachVolumeTestJSON-795486824 None] Lock "cinder-quobyte-8ed7d327-1769-4bd2-8582-53074af0040a" acquired by "delete_volume" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:53 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b55e5b9-f3d8-4fce-a74f-78632d21c096]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a9f597b7-fc2a-42ec-b06e-e9d7da6dd0d8 tempest-AttachVolumeTestJSON-795486824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8ed7d327-1769-4bd2-8582-53074af0040a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-9fbb08e5-0467-4f9d-a869-a5a8f72ae7c5 tempest-ServerActionsTestOtherA-151106859 None] Acquiring lock "cinder-fb665edb-1e27-462f-8c66-ed9ce5c770e7-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-9fbb08e5-0467-4f9d-a869-a5a8f72ae7c5 tempest-ServerActionsTestOtherA-151106859 None] Lock "cinder-fb665edb-1e27-462f-8c66-ed9ce5c770e7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:53 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8ed7d327-1769-4bd2-8582-53074af0040a Nov 05 03:46:53 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-9fbb08e5-0467-4f9d-a869-a5a8f72ae7c5 tempest-ServerActionsTestOtherA-151106859 None] Acquiring lock "cinder-quobyte-fb665edb-1e27-462f-8c66-ed9ce5c770e7" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-9fbb08e5-0467-4f9d-a869-a5a8f72ae7c5 tempest-ServerActionsTestOtherA-151106859 None] Lock "cinder-quobyte-fb665edb-1e27-462f-8c66-ed9ce5c770e7" acquired by "delete_volume" :: waited 0.028s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:53 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13701b4-d53f-40ca-96d1-eafaa029807d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-9fbb08e5-0467-4f9d-a869-a5a8f72ae7c5 tempest-ServerActionsTestOtherA-151106859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:53 devstack sudo[94188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7 Nov 05 03:46:53 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:53 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a9f597b7-fc2a-42ec-b06e-e9d7da6dd0d8 tempest-AttachVolumeTestJSON-795486824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8ed7d327-1769-4bd2-8582-53074af0040a" returned: 0 in 0.525s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a9f597b7-fc2a-42ec-b06e-e9d7da6dd0d8 tempest-AttachVolumeTestJSON-795486824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8ed7d327-1769-4bd2-8582-53074af0040a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:53 devstack sudo[94193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8ed7d327-1769-4bd2-8582-53074af0040a Nov 05 03:46:53 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:54 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-9fbb08e5-0467-4f9d-a869-a5a8f72ae7c5 tempest-ServerActionsTestOtherA-151106859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7" returned: 0 in 0.618s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-9fbb08e5-0467-4f9d-a869-a5a8f72ae7c5 tempest-ServerActionsTestOtherA-151106859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:54 devstack sudo[94199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7 Nov 05 03:46:54 devstack sudo[94199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:54 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a9f597b7-fc2a-42ec-b06e-e9d7da6dd0d8 tempest-AttachVolumeTestJSON-795486824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8ed7d327-1769-4bd2-8582-53074af0040a" returned: 0 in 0.484s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a9f597b7-fc2a-42ec-b06e-e9d7da6dd0d8 tempest-AttachVolumeTestJSON-795486824 None] Lock "cinder-quobyte-8ed7d327-1769-4bd2-8582-53074af0040a" released by "delete_volume" :: held 1.065s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-a9f597b7-fc2a-42ec-b06e-e9d7da6dd0d8 tempest-AttachVolumeTestJSON-795486824 None] Created reservations ['4509ff22-2f4a-4ba7-b3ff-2d572c23aa2a', 'bfd7c260-7972-4bfd-991d-e11d90c31c0a', '2336eb08-2ec0-4265-90da-0a79216cd183', '84d00ffc-0e82-45ad-afdf-d6eba39e3958'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8e109451-e836-4fe5-9e1c-f6c9999e87a2 tempest-ServerActionsTestOtherA-151106859 None] Acquiring lock "cinder-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8e109451-e836-4fe5-9e1c-f6c9999e87a2 tempest-ServerActionsTestOtherA-151106859 None] Lock "cinder-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8e109451-e836-4fe5-9e1c-f6c9999e87a2 tempest-ServerActionsTestOtherA-151106859 None] Acquiring lock "cinder-quobyte-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a9f597b7-fc2a-42ec-b06e-e9d7da6dd0d8 tempest-AttachVolumeTestJSON-795486824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a9f597b7-fc2a-42ec-b06e-e9d7da6dd0d8 tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a9f597b7-fc2a-42ec-b06e-e9d7da6dd0d8 tempest-AttachVolumeTestJSON-795486824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a9f597b7-fc2a-42ec-b06e-e9d7da6dd0d8 tempest-AttachVolumeTestJSON-795486824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a9f597b7-fc2a-42ec-b06e-e9d7da6dd0d8 tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a9f597b7-fc2a-42ec-b06e-e9d7da6dd0d8 tempest-AttachVolumeTestJSON-795486824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8e109451-e836-4fe5-9e1c-f6c9999e87a2 tempest-ServerActionsTestOtherA-151106859 None] Lock "cinder-quobyte-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9" acquired by "delete_volume" :: waited 0.057s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:54 devstack sudo[94202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:46:54 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:54 devstack sudo[94199]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-9fbb08e5-0467-4f9d-a869-a5a8f72ae7c5 tempest-ServerActionsTestOtherA-151106859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fb665edb-1e27-462f-8c66-ed9ce5c770e7" returned: 0 in 0.431s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-9fbb08e5-0467-4f9d-a869-a5a8f72ae7c5 tempest-ServerActionsTestOtherA-151106859 None] Lock "cinder-quobyte-fb665edb-1e27-462f-8c66-ed9ce5c770e7" released by "delete_volume" :: held 1.116s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e459d5d4-e625-471e-adfb-684bd86ed869]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e109451-e836-4fe5-9e1c-f6c9999e87a2 tempest-ServerActionsTestOtherA-151106859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG cinder.quota [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-9fbb08e5-0467-4f9d-a869-a5a8f72ae7c5 tempest-ServerActionsTestOtherA-151106859 None] Created reservations ['be269fee-6811-454f-80ae-675ea79d4824', '338d6a61-4dfb-4ba6-a06f-4e3de557da7d', 'e20659bd-579f-445f-bcea-bbc5b164a4fe', '344ef0ee-148e-4d13-b51c-18693b2d253f'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:46:54 devstack sudo[94204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9 Nov 05 03:46:54 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-9fbb08e5-0467-4f9d-a869-a5a8f72ae7c5 tempest-ServerActionsTestOtherA-151106859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-9fbb08e5-0467-4f9d-a869-a5a8f72ae7c5 tempest-ServerActionsTestOtherA-151106859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-9fbb08e5-0467-4f9d-a869-a5a8f72ae7c5 tempest-ServerActionsTestOtherA-151106859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-9fbb08e5-0467-4f9d-a869-a5a8f72ae7c5 tempest-ServerActionsTestOtherA-151106859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-9fbb08e5-0467-4f9d-a869-a5a8f72ae7c5 tempest-ServerActionsTestOtherA-151106859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-9fbb08e5-0467-4f9d-a869-a5a8f72ae7c5 tempest-ServerActionsTestOtherA-151106859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:55 devstack sudo[94206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:46:55 devstack sudo[94206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:55 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a9f597b7-fc2a-42ec-b06e-e9d7da6dd0d8 tempest-AttachVolumeTestJSON-795486824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.483s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-a9f597b7-fc2a-42ec-b06e-e9d7da6dd0d8 tempest-AttachVolumeTestJSON-795486824 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:46:55 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-a9f597b7-fc2a-42ec-b06e-e9d7da6dd0d8 tempest-AttachVolumeTestJSON-795486824 None] Deleted volume successfully. Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a9f597b7-fc2a-42ec-b06e-e9d7da6dd0d8 tempest-AttachVolumeTestJSON-795486824 None] Lock "cinder-8ed7d327-1769-4bd2-8582-53074af0040a-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:55 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e109451-e836-4fe5-9e1c-f6c9999e87a2 tempest-ServerActionsTestOtherA-151106859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9" returned: 0 in 0.556s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e109451-e836-4fe5-9e1c-f6c9999e87a2 tempest-ServerActionsTestOtherA-151106859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:55 devstack sudo[94212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9 Nov 05 03:46:55 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:55 devstack sudo[94206]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-9fbb08e5-0467-4f9d-a869-a5a8f72ae7c5 tempest-ServerActionsTestOtherA-151106859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.398s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.manager [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-9fbb08e5-0467-4f9d-a869-a5a8f72ae7c5 tempest-ServerActionsTestOtherA-151106859 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:46:55 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-9fbb08e5-0467-4f9d-a869-a5a8f72ae7c5 tempest-ServerActionsTestOtherA-151106859 None] Deleted volume successfully. Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-c2e4b846-0379-48fa-b8d2-dbe22dee5ac1 req-9fbb08e5-0467-4f9d-a869-a5a8f72ae7c5 tempest-ServerActionsTestOtherA-151106859 None] Lock "cinder-fb665edb-1e27-462f-8c66-ed9ce5c770e7-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ba0a8740-40f2-4df6-b394-ab13b373c4c8 tempest-AttachVolumeTestJSON-795486824 None] Acquiring lock "cinder-4f134074-d8f8-460e-8a9f-d5327ffac8d7-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Flow 'volume_create_manager' (3aa78152-f86b-4b90-815e-7cca49c9cf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773900f1-52c6-439a-a9f6-753f324468de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ba0a8740-40f2-4df6-b394-ab13b373c4c8 tempest-AttachVolumeTestJSON-795486824 None] Lock "cinder-4f134074-d8f8-460e-8a9f-d5327ffac8d7-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773900f1-52c6-439a-a9f6-753f324468de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-159927422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04025b8-9274-47b3-b1b2-b6916acb2ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f51d59625f4c1e9a42e6601a518279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:55Z,use_quota=True,user_id='539d28e9d3ed49df83a6e1eb4c74ac71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024a29d6-12dc-48c3-a557-bb6e47773648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:55 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024a29d6-12dc-48c3-a557-bb6e47773648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3692de-dfc2-4cf5-9ec1-574a5d27bc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3692de-dfc2-4cf5-9ec1-574a5d27bc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd04025b8-9274-47b3-b1b2-b6916acb2ca3', 'volume_name': 'volume-d04025b8-9274-47b3-b1b2-b6916acb2ca3', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e496d6c-c67f-4b3e-8d77-e9c574da84be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e496d6c-c67f-4b3e-8d77-e9c574da84be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1637e0db-6de1-4f3b-8db1-9547686c86b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:55 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Volume d04025b8-9274-47b3-b1b2-b6916acb2ca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d04025b8-9274-47b3-b1b2-b6916acb2ca3', 'volume_size': 1} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-159927422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04025b8-9274-47b3-b1b2-b6916acb2ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f51d59625f4c1e9a42e6601a518279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:46:55Z,use_quota=True,user_id='539d28e9d3ed49df83a6e1eb4c74ac71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Creating volume d04025b8-9274-47b3-b1b2-b6916acb2ca3 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:46:55 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d04025b8-9274-47b3-b1b2-b6916acb2ca3 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e109451-e836-4fe5-9e1c-f6c9999e87a2 tempest-ServerActionsTestOtherA-151106859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9" returned: 0 in 0.396s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:55 devstack sudo[94216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d04025b8-9274-47b3-b1b2-b6916acb2ca3 1073741824 Nov 05 03:46:55 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8e109451-e836-4fe5-9e1c-f6c9999e87a2 tempest-ServerActionsTestOtherA-151106859 None] Lock "cinder-quobyte-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9" released by "delete_volume" :: held 1.045s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ba0a8740-40f2-4df6-b394-ab13b373c4c8 tempest-AttachVolumeTestJSON-795486824 None] Acquiring lock "cinder-quobyte-4f134074-d8f8-460e-8a9f-d5327ffac8d7" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ba0a8740-40f2-4df6-b394-ab13b373c4c8 tempest-AttachVolumeTestJSON-795486824 None] Lock "cinder-quobyte-4f134074-d8f8-460e-8a9f-d5327ffac8d7" acquired by "delete_volume" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-8e109451-e836-4fe5-9e1c-f6c9999e87a2 tempest-ServerActionsTestOtherA-151106859 None] Created reservations ['e1def101-df89-4b9d-955c-3732979f73c8', 'fcb506ac-5612-43cd-86d0-8a72c67f21cc', '4df0fb95-21d8-476c-aabb-cb6261dba786', '944b1a50-72fc-44e2-a532-7c5fe24e11d7'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[982a2857-3374-4202-bd85-b4cafc626042]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ba0a8740-40f2-4df6-b394-ab13b373c4c8 tempest-AttachVolumeTestJSON-795486824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4f134074-d8f8-460e-8a9f-d5327ffac8d7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8e109451-e836-4fe5-9e1c-f6c9999e87a2 tempest-ServerActionsTestOtherA-151106859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8e109451-e836-4fe5-9e1c-f6c9999e87a2 tempest-ServerActionsTestOtherA-151106859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8e109451-e836-4fe5-9e1c-f6c9999e87a2 tempest-ServerActionsTestOtherA-151106859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8e109451-e836-4fe5-9e1c-f6c9999e87a2 tempest-ServerActionsTestOtherA-151106859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8e109451-e836-4fe5-9e1c-f6c9999e87a2 tempest-ServerActionsTestOtherA-151106859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e109451-e836-4fe5-9e1c-f6c9999e87a2 tempest-ServerActionsTestOtherA-151106859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:55 devstack sudo[94218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4f134074-d8f8-460e-8a9f-d5327ffac8d7 Nov 05 03:46:55 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:55 devstack sudo[94221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:46:55 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:56 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d04025b8-9274-47b3-b1b2-b6916acb2ca3 1073741824" returned: 0 in 0.520s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d04025b8-9274-47b3-b1b2-b6916acb2ca3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:56 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e109451-e836-4fe5-9e1c-f6c9999e87a2 tempest-ServerActionsTestOtherA-151106859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.335s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-8e109451-e836-4fe5-9e1c-f6c9999e87a2 tempest-ServerActionsTestOtherA-151106859 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:46:56 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:56 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-8e109451-e836-4fe5-9e1c-f6c9999e87a2 tempest-ServerActionsTestOtherA-151106859 None] Deleted volume successfully. Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ba0a8740-40f2-4df6-b394-ab13b373c4c8 tempest-AttachVolumeTestJSON-795486824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4f134074-d8f8-460e-8a9f-d5327ffac8d7" returned: 0 in 0.458s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ba0a8740-40f2-4df6-b394-ab13b373c4c8 tempest-AttachVolumeTestJSON-795486824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4f134074-d8f8-460e-8a9f-d5327ffac8d7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:56 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d04025b8-9274-47b3-b1b2-b6916acb2ca3 Nov 05 03:46:56 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8e109451-e836-4fe5-9e1c-f6c9999e87a2 tempest-ServerActionsTestOtherA-151106859 None] Lock "cinder-ff982eb1-ffff-4f2e-9bf8-c1b5fb134eb9-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:56 devstack sudo[94235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4f134074-d8f8-460e-8a9f-d5327ffac8d7 Nov 05 03:46:56 devstack sudo[94235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:56 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d04025b8-9274-47b3-b1b2-b6916acb2ca3" returned: 0 in 0.294s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1637e0db-6de1-4f3b-8db1-9547686c86b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d04025b8-9274-47b3-b1b2-b6916acb2ca3', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19708707-2e95-4854-a2f7-e7c35dd383fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:46:56 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Volume volume-d04025b8-9274-47b3-b1b2-b6916acb2ca3 (d04025b8-9274-47b3-b1b2-b6916acb2ca3): created successfully Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19708707-2e95-4854-a2f7-e7c35dd383fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Flow 'volume_create_manager' (3aa78152-f86b-4b90-815e-7cca49c9cf69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:46:56 devstack sudo[94235]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ba0a8740-40f2-4df6-b394-ab13b373c4c8 tempest-AttachVolumeTestJSON-795486824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4f134074-d8f8-460e-8a9f-d5327ffac8d7" returned: 0 in 0.314s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ba0a8740-40f2-4df6-b394-ab13b373c4c8 tempest-AttachVolumeTestJSON-795486824 None] Lock "cinder-quobyte-4f134074-d8f8-460e-8a9f-d5327ffac8d7" released by "delete_volume" :: held 0.830s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:56 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-addfd33b-ea8b-4f94-9259-71e3e093abe2 tempest-VolumesTransfersTest-738412102 None] Created volume successfully. Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-ba0a8740-40f2-4df6-b394-ab13b373c4c8 tempest-AttachVolumeTestJSON-795486824 None] Created reservations ['64f2aad0-ca39-4166-9a63-568f7c492b7a', 'dc3d76ae-484b-472a-9079-766ce465315f', '24f590c4-e943-4ac9-9a6c-16504fb3c3a7', '823a91de-dd09-439a-89db-1d40f427eb0e'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ba0a8740-40f2-4df6-b394-ab13b373c4c8 tempest-AttachVolumeTestJSON-795486824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ba0a8740-40f2-4df6-b394-ab13b373c4c8 tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ba0a8740-40f2-4df6-b394-ab13b373c4c8 tempest-AttachVolumeTestJSON-795486824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ba0a8740-40f2-4df6-b394-ab13b373c4c8 tempest-AttachVolumeTestJSON-795486824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ba0a8740-40f2-4df6-b394-ab13b373c4c8 tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ba0a8740-40f2-4df6-b394-ab13b373c4c8 tempest-AttachVolumeTestJSON-795486824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:56 devstack sudo[94240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:46:56 devstack sudo[94240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:57 devstack sudo[94240]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ba0a8740-40f2-4df6-b394-ab13b373c4c8 tempest-AttachVolumeTestJSON-795486824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.476s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:57 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-ba0a8740-40f2-4df6-b394-ab13b373c4c8 tempest-AttachVolumeTestJSON-795486824 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:46:57 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-ba0a8740-40f2-4df6-b394-ab13b373c4c8 tempest-AttachVolumeTestJSON-795486824 None] Deleted volume successfully. Nov 05 03:46:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ba0a8740-40f2-4df6-b394-ab13b373c4c8 tempest-AttachVolumeTestJSON-795486824 None] Lock "cinder-4f134074-d8f8-460e-8a9f-d5327ffac8d7-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6f4b4c23-2aba-46c8-82a9-4e275e983050 tempest-AttachVolumeTestJSON-795486824 None] Acquiring lock "cinder-c641c2ac-7537-451e-a33f-06df6b2ccd9f-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6f4b4c23-2aba-46c8-82a9-4e275e983050 tempest-AttachVolumeTestJSON-795486824 None] Lock "cinder-c641c2ac-7537-451e-a33f-06df6b2ccd9f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:58 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6f4b4c23-2aba-46c8-82a9-4e275e983050 tempest-AttachVolumeTestJSON-795486824 None] Acquiring lock "cinder-quobyte-c641c2ac-7537-451e-a33f-06df6b2ccd9f" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:58 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6f4b4c23-2aba-46c8-82a9-4e275e983050 tempest-AttachVolumeTestJSON-795486824 None] Lock "cinder-quobyte-c641c2ac-7537-451e-a33f-06df6b2ccd9f" acquired by "delete_volume" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:58 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[934b0f95-9d72-4cff-ad39-8b3a39060ae4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6f4b4c23-2aba-46c8-82a9-4e275e983050 tempest-AttachVolumeTestJSON-795486824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c641c2ac-7537-451e-a33f-06df6b2ccd9f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:58 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c641c2ac-7537-451e-a33f-06df6b2ccd9f Nov 05 03:46:58 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:46:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:58 devstack sudo[94283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:46:58 devstack sudo[94283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:58 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-df3e322b-8875-49cf-8cc3-dc19f5f8be59 tempest-VolumesTransfersTest-364823322 None] Transfer volume completed successfully. Nov 05 03:46:58 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6f4b4c23-2aba-46c8-82a9-4e275e983050 tempest-AttachVolumeTestJSON-795486824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c641c2ac-7537-451e-a33f-06df6b2ccd9f" returned: 0 in 0.766s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6f4b4c23-2aba-46c8-82a9-4e275e983050 tempest-AttachVolumeTestJSON-795486824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c641c2ac-7537-451e-a33f-06df6b2ccd9f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:58 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c641c2ac-7537-451e-a33f-06df6b2ccd9f Nov 05 03:46:58 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:59 devstack sudo[94283]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.617s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 28 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:46:59 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6f4b4c23-2aba-46c8-82a9-4e275e983050 tempest-AttachVolumeTestJSON-795486824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c641c2ac-7537-451e-a33f-06df6b2ccd9f" returned: 0 in 0.485s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6f4b4c23-2aba-46c8-82a9-4e275e983050 tempest-AttachVolumeTestJSON-795486824 None] Lock "cinder-quobyte-c641c2ac-7537-451e-a33f-06df6b2ccd9f" released by "delete_volume" :: held 1.319s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-6f4b4c23-2aba-46c8-82a9-4e275e983050 tempest-AttachVolumeTestJSON-795486824 None] Created reservations ['231c8a2f-bf91-4258-b53b-0c5e3f153a72', '81450a8d-5a5b-4076-8518-0cf494b8f460', 'e428f929-4353-43b0-86f1-a90b4984dc39', '603ab72a-93f2-47f0-9a0d-19716edae3e2'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6f4b4c23-2aba-46c8-82a9-4e275e983050 tempest-AttachVolumeTestJSON-795486824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6f4b4c23-2aba-46c8-82a9-4e275e983050 tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6f4b4c23-2aba-46c8-82a9-4e275e983050 tempest-AttachVolumeTestJSON-795486824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6f4b4c23-2aba-46c8-82a9-4e275e983050 tempest-AttachVolumeTestJSON-795486824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6f4b4c23-2aba-46c8-82a9-4e275e983050 tempest-AttachVolumeTestJSON-795486824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6f4b4c23-2aba-46c8-82a9-4e275e983050 tempest-AttachVolumeTestJSON-795486824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:59 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:46:59 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-374e2098-2cb5-480d-ae4e-30d83560578b tempest-VolumesTransfersTest-426446830 None] Acquiring lock "cinder-d04025b8-9274-47b3-b1b2-b6916acb2ca3-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-374e2098-2cb5-480d-ae4e-30d83560578b tempest-VolumesTransfersTest-426446830 None] Lock "cinder-d04025b8-9274-47b3-b1b2-b6916acb2ca3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-374e2098-2cb5-480d-ae4e-30d83560578b tempest-VolumesTransfersTest-426446830 None] Acquiring lock "cinder-quobyte-d04025b8-9274-47b3-b1b2-b6916acb2ca3" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-374e2098-2cb5-480d-ae4e-30d83560578b tempest-VolumesTransfersTest-426446830 None] Lock "cinder-quobyte-d04025b8-9274-47b3-b1b2-b6916acb2ca3" acquired by "delete_volume" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:46:59 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6f4b4c23-2aba-46c8-82a9-4e275e983050 tempest-AttachVolumeTestJSON-795486824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.309s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-6f4b4c23-2aba-46c8-82a9-4e275e983050 tempest-AttachVolumeTestJSON-795486824 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:46:59 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-6f4b4c23-2aba-46c8-82a9-4e275e983050 tempest-AttachVolumeTestJSON-795486824 None] Deleted volume successfully. Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67e3fe4-4519-4e54-9e43-5c1f97b1d7ba]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-374e2098-2cb5-480d-ae4e-30d83560578b tempest-VolumesTransfersTest-426446830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d04025b8-9274-47b3-b1b2-b6916acb2ca3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:46:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6f4b4c23-2aba-46c8-82a9-4e275e983050 tempest-AttachVolumeTestJSON-795486824 None] Lock "cinder-c641c2ac-7537-451e-a33f-06df6b2ccd9f-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:46:59 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d04025b8-9274-47b3-b1b2-b6916acb2ca3 Nov 05 03:46:59 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:00 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-374e2098-2cb5-480d-ae4e-30d83560578b tempest-VolumesTransfersTest-426446830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d04025b8-9274-47b3-b1b2-b6916acb2ca3" returned: 0 in 0.498s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-374e2098-2cb5-480d-ae4e-30d83560578b tempest-VolumesTransfersTest-426446830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d04025b8-9274-47b3-b1b2-b6916acb2ca3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:00 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d04025b8-9274-47b3-b1b2-b6916acb2ca3 Nov 05 03:47:00 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:00 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-374e2098-2cb5-480d-ae4e-30d83560578b tempest-VolumesTransfersTest-426446830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d04025b8-9274-47b3-b1b2-b6916acb2ca3" returned: 0 in 0.279s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-374e2098-2cb5-480d-ae4e-30d83560578b tempest-VolumesTransfersTest-426446830 None] Lock "cinder-quobyte-d04025b8-9274-47b3-b1b2-b6916acb2ca3" released by "delete_volume" :: held 0.830s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:00 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-374e2098-2cb5-480d-ae4e-30d83560578b tempest-VolumesTransfersTest-426446830 None] Created reservations ['bd35e7b2-1792-4a6d-ad69-c47c44907478', '8b84032d-8ca2-4440-9b77-64f4df5ae373', 'bff2965b-0def-44e6-92bb-1ab25135e5f4', '94ecddc0-b9c1-4c88-b3f5-bb89b986d215'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:47:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-374e2098-2cb5-480d-ae4e-30d83560578b tempest-VolumesTransfersTest-426446830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-374e2098-2cb5-480d-ae4e-30d83560578b tempest-VolumesTransfersTest-426446830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-374e2098-2cb5-480d-ae4e-30d83560578b tempest-VolumesTransfersTest-426446830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-374e2098-2cb5-480d-ae4e-30d83560578b tempest-VolumesTransfersTest-426446830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-374e2098-2cb5-480d-ae4e-30d83560578b tempest-VolumesTransfersTest-426446830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-374e2098-2cb5-480d-ae4e-30d83560578b tempest-VolumesTransfersTest-426446830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:00 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:47:00 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:01 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-374e2098-2cb5-480d-ae4e-30d83560578b tempest-VolumesTransfersTest-426446830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.349s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-374e2098-2cb5-480d-ae4e-30d83560578b tempest-VolumesTransfersTest-426446830 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:47:01 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-374e2098-2cb5-480d-ae4e-30d83560578b tempest-VolumesTransfersTest-426446830 None] Deleted volume successfully. Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-374e2098-2cb5-480d-ae4e-30d83560578b tempest-VolumesTransfersTest-426446830 None] Lock "cinder-d04025b8-9274-47b3-b1b2-b6916acb2ca3-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Flow 'volume_create_manager' (ace2f49c-7db3-4987-837e-9a76b4213230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d495d84b-a9c9-40c0-a9c1-097ed4583235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d495d84b-a9c9-40c0-a9c1-097ed4583235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1554023767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8241a7e-2b5b-46f5-997f-466326c576a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f51d59625f4c1e9a42e6601a518279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:02Z,use_quota=True,user_id='539d28e9d3ed49df83a6e1eb4c74ac71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5cb3ce-b3b1-4af5-a7f1-88359a5965b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5cb3ce-b3b1-4af5-a7f1-88359a5965b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca92c76-1d1b-4287-a40e-01dee77e9703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca92c76-1d1b-4287-a40e-01dee77e9703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8241a7e-2b5b-46f5-997f-466326c576a7', 'volume_name': 'volume-d8241a7e-2b5b-46f5-997f-466326c576a7', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6d09d1-53d9-4447-9815-8d9b957c70cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6d09d1-53d9-4447-9815-8d9b957c70cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5728d5-f246-4064-84f7-e5aebad9e21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:01 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Volume d8241a7e-2b5b-46f5-997f-466326c576a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8241a7e-2b5b-46f5-997f-466326c576a7', 'volume_size': 1} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1554023767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8241a7e-2b5b-46f5-997f-466326c576a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5f51d59625f4c1e9a42e6601a518279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:02Z,use_quota=True,user_id='539d28e9d3ed49df83a6e1eb4c74ac71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Creating volume d8241a7e-2b5b-46f5-997f-466326c576a7 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:47:01 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:47:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8241a7e-2b5b-46f5-997f-466326c576a7 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:01 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8241a7e-2b5b-46f5-997f-466326c576a7 1073741824 Nov 05 03:47:01 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:02 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8241a7e-2b5b-46f5-997f-466326c576a7 1073741824" returned: 0 in 0.556s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8241a7e-2b5b-46f5-997f-466326c576a7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:02 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8241a7e-2b5b-46f5-997f-466326c576a7 Nov 05 03:47:02 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:02 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8241a7e-2b5b-46f5-997f-466326c576a7" returned: 0 in 0.288s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:02 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:47:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:02 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5728d5-f246-4064-84f7-e5aebad9e21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8241a7e-2b5b-46f5-997f-466326c576a7', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:02 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec612068-9f5d-4fa7-bf11-e22bb92406f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:02 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Volume volume-d8241a7e-2b5b-46f5-997f-466326c576a7 (d8241a7e-2b5b-46f5-997f-466326c576a7): created successfully Nov 05 03:47:02 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec612068-9f5d-4fa7-bf11-e22bb92406f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:02 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Flow 'volume_create_manager' (ace2f49c-7db3-4987-837e-9a76b4213230) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:02 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f753420a-2fd8-4bce-bd0b-0f2f79de51fd tempest-VolumesTransfersTest-738412102 None] Created volume successfully. Nov 05 03:47:04 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-da3e0245-bca1-41d7-8769-7e89637ea859 tempest-VolumesTransfersTest-426446830 None] Acquiring lock "cinder-d8241a7e-2b5b-46f5-997f-466326c576a7-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:04 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-da3e0245-bca1-41d7-8769-7e89637ea859 tempest-VolumesTransfersTest-426446830 None] Lock "cinder-d8241a7e-2b5b-46f5-997f-466326c576a7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:04 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=103,cinder:INSERT=18,cinder:UPDATE=100,cinder:DELETE=9 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:47:04 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:UPDATE=111,cinder:SELECT=103,cinder:DELETE=8,cinder:INSERT=30 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:47:04 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-da3e0245-bca1-41d7-8769-7e89637ea859 tempest-VolumesTransfersTest-426446830 None] Acquiring lock "cinder-quobyte-d8241a7e-2b5b-46f5-997f-466326c576a7" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:04 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-da3e0245-bca1-41d7-8769-7e89637ea859 tempest-VolumesTransfersTest-426446830 None] Lock "cinder-quobyte-d8241a7e-2b5b-46f5-997f-466326c576a7" acquired by "delete_volume" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:04 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d6df06-6720-45bc-98a4-450ae536f08f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-da3e0245-bca1-41d7-8769-7e89637ea859 tempest-VolumesTransfersTest-426446830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8241a7e-2b5b-46f5-997f-466326c576a7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:04 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8241a7e-2b5b-46f5-997f-466326c576a7 Nov 05 03:47:04 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:04 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-da3e0245-bca1-41d7-8769-7e89637ea859 tempest-VolumesTransfersTest-426446830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8241a7e-2b5b-46f5-997f-466326c576a7" returned: 0 in 0.439s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-da3e0245-bca1-41d7-8769-7e89637ea859 tempest-VolumesTransfersTest-426446830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8241a7e-2b5b-46f5-997f-466326c576a7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:04 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8241a7e-2b5b-46f5-997f-466326c576a7 Nov 05 03:47:04 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:04 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-da3e0245-bca1-41d7-8769-7e89637ea859 tempest-VolumesTransfersTest-426446830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8241a7e-2b5b-46f5-997f-466326c576a7" returned: 0 in 0.321s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:04 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-da3e0245-bca1-41d7-8769-7e89637ea859 tempest-VolumesTransfersTest-426446830 None] Lock "cinder-quobyte-d8241a7e-2b5b-46f5-997f-466326c576a7" released by "delete_volume" :: held 0.821s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:05 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-da3e0245-bca1-41d7-8769-7e89637ea859 tempest-VolumesTransfersTest-426446830 None] Created reservations ['e4c73031-4261-4c66-8ff4-3bcf20c7e4c3', 'f52fc354-d5ef-40a1-9ec2-802ac5f26785', 'd4b157dc-24ff-4796-b14b-c0cdd4ef7ed1', 'cf4a1087-e55a-4a70-a0a7-895fba81d342'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:47:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-da3e0245-bca1-41d7-8769-7e89637ea859 tempest-VolumesTransfersTest-426446830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-da3e0245-bca1-41d7-8769-7e89637ea859 tempest-VolumesTransfersTest-426446830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-da3e0245-bca1-41d7-8769-7e89637ea859 tempest-VolumesTransfersTest-426446830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-da3e0245-bca1-41d7-8769-7e89637ea859 tempest-VolumesTransfersTest-426446830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-da3e0245-bca1-41d7-8769-7e89637ea859 tempest-VolumesTransfersTest-426446830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-da3e0245-bca1-41d7-8769-7e89637ea859 tempest-VolumesTransfersTest-426446830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:05 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:47:05 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:05 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3b800a35-18d7-423b-a481-d40ee905d42a tempest-AttachVolumeShelveTestJSON-157895211 None] Acquiring lock "cinder-05da92f6-f78f-46b5-aa85-6e67f39bb090-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:05 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3b800a35-18d7-423b-a481-d40ee905d42a tempest-AttachVolumeShelveTestJSON-157895211 None] Lock "cinder-05da92f6-f78f-46b5-aa85-6e67f39bb090-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:05 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3b800a35-18d7-423b-a481-d40ee905d42a tempest-AttachVolumeShelveTestJSON-157895211 None] Acquiring lock "cinder-quobyte-05da92f6-f78f-46b5-aa85-6e67f39bb090" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:05 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3b800a35-18d7-423b-a481-d40ee905d42a tempest-AttachVolumeShelveTestJSON-157895211 None] Lock "cinder-quobyte-05da92f6-f78f-46b5-aa85-6e67f39bb090" acquired by "delete_volume" :: waited 0.033s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:05 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-da3e0245-bca1-41d7-8769-7e89637ea859 tempest-VolumesTransfersTest-426446830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.521s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:05 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-da3e0245-bca1-41d7-8769-7e89637ea859 tempest-VolumesTransfersTest-426446830 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:47:05 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[579afeba-09e1-4a75-a384-44d2be19ac4f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:05 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-da3e0245-bca1-41d7-8769-7e89637ea859 tempest-VolumesTransfersTest-426446830 None] Deleted volume successfully. Nov 05 03:47:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3b800a35-18d7-423b-a481-d40ee905d42a tempest-AttachVolumeShelveTestJSON-157895211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-05da92f6-f78f-46b5-aa85-6e67f39bb090 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:05 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-da3e0245-bca1-41d7-8769-7e89637ea859 tempest-VolumesTransfersTest-426446830 None] Lock "cinder-d8241a7e-2b5b-46f5-997f-466326c576a7-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:05 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-05da92f6-f78f-46b5-aa85-6e67f39bb090 Nov 05 03:47:05 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:06 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3b800a35-18d7-423b-a481-d40ee905d42a tempest-AttachVolumeShelveTestJSON-157895211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-05da92f6-f78f-46b5-aa85-6e67f39bb090" returned: 0 in 0.582s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3b800a35-18d7-423b-a481-d40ee905d42a tempest-AttachVolumeShelveTestJSON-157895211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-05da92f6-f78f-46b5-aa85-6e67f39bb090 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:06 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-05da92f6-f78f-46b5-aa85-6e67f39bb090 Nov 05 03:47:06 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:06 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3b800a35-18d7-423b-a481-d40ee905d42a tempest-AttachVolumeShelveTestJSON-157895211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-05da92f6-f78f-46b5-aa85-6e67f39bb090" returned: 0 in 0.368s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3b800a35-18d7-423b-a481-d40ee905d42a tempest-AttachVolumeShelveTestJSON-157895211 None] Lock "cinder-quobyte-05da92f6-f78f-46b5-aa85-6e67f39bb090" released by "delete_volume" :: held 1.050s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:06 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-3b800a35-18d7-423b-a481-d40ee905d42a tempest-AttachVolumeShelveTestJSON-157895211 None] Created reservations ['f9b000ab-f08e-4b73-b8f6-17d2e9713fc2', 'ab6b4798-404b-4fcf-9a96-e9fb7654151c', '08bba17d-075c-4bcd-b6ec-d9a21b230328', '7fd4f675-57cb-4fa2-b74e-6ed64078d717'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:47:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3b800a35-18d7-423b-a481-d40ee905d42a tempest-AttachVolumeShelveTestJSON-157895211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3b800a35-18d7-423b-a481-d40ee905d42a tempest-AttachVolumeShelveTestJSON-157895211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3b800a35-18d7-423b-a481-d40ee905d42a tempest-AttachVolumeShelveTestJSON-157895211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3b800a35-18d7-423b-a481-d40ee905d42a tempest-AttachVolumeShelveTestJSON-157895211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3b800a35-18d7-423b-a481-d40ee905d42a tempest-AttachVolumeShelveTestJSON-157895211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3b800a35-18d7-423b-a481-d40ee905d42a tempest-AttachVolumeShelveTestJSON-157895211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:06 devstack sudo[94386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:47:06 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:07 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3b800a35-18d7-423b-a481-d40ee905d42a tempest-AttachVolumeShelveTestJSON-157895211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.367s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:07 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-3b800a35-18d7-423b-a481-d40ee905d42a tempest-AttachVolumeShelveTestJSON-157895211 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:47:07 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-3b800a35-18d7-423b-a481-d40ee905d42a tempest-AttachVolumeShelveTestJSON-157895211 None] Deleted volume successfully. Nov 05 03:47:07 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3b800a35-18d7-423b-a481-d40ee905d42a tempest-AttachVolumeShelveTestJSON-157895211 None] Lock "cinder-05da92f6-f78f-46b5-aa85-6e67f39bb090-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Flow 'volume_create_manager' (02b0a649-9558-4cb5-98a4-bf153b082fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d746965c-b8b7-485b-bee0-4ad12763f3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d746965c-b8b7-485b-bee0-4ad12763f3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2043233750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ea2dd3649d8475bbf2e8c4b6b8f19ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:13Z,use_quota=True,user_id='1954bc8fd89545bba4e8e07bbea61e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669b4c4e-b334-4359-80ec-2a2552a030a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (669b4c4e-b334-4359-80ec-2a2552a030a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378c9678-5c02-4986-8220-9e351faa2f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378c9678-5c02-4986-8220-9e351faa2f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe', 'volume_name': 'volume-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e191c4f-137d-4fdb-a7b1-7e0a3dbcf494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e191c4f-137d-4fdb-a7b1-7e0a3dbcf494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f80eeb-d884-4400-b534-69b8a4512a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:12 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Volume ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe', 'volume_size': 1} Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2043233750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ea2dd3649d8475bbf2e8c4b6b8f19ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:13Z,use_quota=True,user_id='1954bc8fd89545bba4e8e07bbea61e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Creating volume ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:47:12 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:47:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:12 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe 1073741824 Nov 05 03:47:12 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:13 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:47:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Flow 'volume_create_manager' (61de50c9-47df-4eba-8abc-b8d25e421d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2a2718-9c89-493e-9310-4c87729523e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2a2718-9c89-493e-9310-4c87729523e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-673581850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7a57bd-d22f-4db6-866f-28e2383ddb0a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3b785def1d124bb6991ec0e72b9b01a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:13Z,use_quota=True,user_id='0e54a2fe644b4179a9c89a5de3079826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be919a9-de7d-43ff-bdee-0329dd01832e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be919a9-de7d-43ff-bdee-0329dd01832e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42c4326-3713-482d-a20c-182b5bbc916f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42c4326-3713-482d-a20c-182b5bbc916f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b7a57bd-d22f-4db6-866f-28e2383ddb0a', 'volume_name': 'volume-3b7a57bd-d22f-4db6-866f-28e2383ddb0a', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a47e68-0dfb-4710-b162-6f341beded28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a47e68-0dfb-4710-b162-6f341beded28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91369891-5a2d-4062-b1a5-2088188cf944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:13 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Volume 3b7a57bd-d22f-4db6-866f-28e2383ddb0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b7a57bd-d22f-4db6-866f-28e2383ddb0a', 'volume_size': 1} Nov 05 03:47:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:13 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe 1073741824" returned: 0 in 0.777s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:13 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe Nov 05 03:47:13 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:14 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe" returned: 0 in 0.293s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.502s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-673581850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b7a57bd-d22f-4db6-866f-28e2383ddb0a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3b785def1d124bb6991ec0e72b9b01a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:13Z,use_quota=True,user_id='0e54a2fe644b4179a9c89a5de3079826',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Creating volume 3b7a57bd-d22f-4db6-866f-28e2383ddb0a {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:47:14 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b7a57bd-d22f-4db6-866f-28e2383ddb0a 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f80eeb-d884-4400-b534-69b8a4512a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:14 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b7a57bd-d22f-4db6-866f-28e2383ddb0a 1073741824 Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a053c3b-b04a-4955-a424-6f9b0ee69e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:14 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:14 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Volume volume-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe (ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe): created successfully Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a053c3b-b04a-4955-a424-6f9b0ee69e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Flow 'volume_create_manager' (02b0a649-9558-4cb5-98a4-bf153b082fef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:14 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-37b8df2e-486f-4937-ac74-e13b0cbdedde tempest-VolumesTestJSON-1620751312 None] Created volume successfully. Nov 05 03:47:14 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b7a57bd-d22f-4db6-866f-28e2383ddb0a 1073741824" returned: 0 in 0.540s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b7a57bd-d22f-4db6-866f-28e2383ddb0a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:14 devstack sudo[94410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b7a57bd-d22f-4db6-866f-28e2383ddb0a Nov 05 03:47:14 devstack sudo[94410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:14 devstack sudo[94410]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b7a57bd-d22f-4db6-866f-28e2383ddb0a" returned: 0 in 0.317s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91369891-5a2d-4062-b1a5-2088188cf944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b7a57bd-d22f-4db6-866f-28e2383ddb0a', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c74d95ef-3c23-40b1-b38f-4e0242af6bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:15 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Volume volume-3b7a57bd-d22f-4db6-866f-28e2383ddb0a (3b7a57bd-d22f-4db6-866f-28e2383ddb0a): created successfully Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c74d95ef-3c23-40b1-b38f-4e0242af6bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Flow 'volume_create_manager' (61de50c9-47df-4eba-8abc-b8d25e421d9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:15 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-4657ff2e-19b5-4699-9af0-d1a271ba74ef req-42105fb9-8113-400d-8d14-8b6ff0365a4e tempest-VolumesGetTestJSON-662589590 None] Created volume successfully. Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Flow 'volume_create_manager' (2220376f-7b34-4143-8640-bf91308b0127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee2ad0f-1164-4cca-a2ca-03596a4c75c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee2ad0f-1164-4cca-a2ca-03596a4c75c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1398284544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bac220d-d4dc-4f4b-88a6-14a9e244b974,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ea2dd3649d8475bbf2e8c4b6b8f19ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:15Z,use_quota=True,user_id='1954bc8fd89545bba4e8e07bbea61e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e62828-f767-4c64-8cc5-dd2a4585712e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13e62828-f767-4c64-8cc5-dd2a4585712e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8da7a6ce-48d6-451e-96e6-fb0235023a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8da7a6ce-48d6-451e-96e6-fb0235023a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bac220d-d4dc-4f4b-88a6-14a9e244b974', 'volume_name': 'volume-3bac220d-d4dc-4f4b-88a6-14a9e244b974', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab24970-e86f-4b04-8291-10235b815ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab24970-e86f-4b04-8291-10235b815ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3911d67b-995d-4f2b-99f2-17568764deea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:15 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Volume 3bac220d-d4dc-4f4b-88a6-14a9e244b974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bac220d-d4dc-4f4b-88a6-14a9e244b974', 'volume_size': 1} Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1398284544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bac220d-d4dc-4f4b-88a6-14a9e244b974,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ea2dd3649d8475bbf2e8c4b6b8f19ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:15Z,use_quota=True,user_id='1954bc8fd89545bba4e8e07bbea61e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Creating volume 3bac220d-d4dc-4f4b-88a6-14a9e244b974 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:47:15 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:47:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3bac220d-d4dc-4f4b-88a6-14a9e244b974 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:15 devstack sudo[94413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3bac220d-d4dc-4f4b-88a6-14a9e244b974 1073741824 Nov 05 03:47:15 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:16 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3bac220d-d4dc-4f4b-88a6-14a9e244b974 1073741824" returned: 0 in 0.588s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3bac220d-d4dc-4f4b-88a6-14a9e244b974 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:16 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3bac220d-d4dc-4f4b-88a6-14a9e244b974 Nov 05 03:47:16 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:16 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-32786abe-f8f2-4994-9955-61cb75a13e0d req-fa573cc9-d1da-4022-84a0-37ec6f574dc1 tempest-VolumesGetTestJSON-662589590 None] Acquiring lock "cinder-3b7a57bd-d22f-4db6-866f-28e2383ddb0a-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:16 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-32786abe-f8f2-4994-9955-61cb75a13e0d req-fa573cc9-d1da-4022-84a0-37ec6f574dc1 tempest-VolumesGetTestJSON-662589590 None] Lock "cinder-3b7a57bd-d22f-4db6-866f-28e2383ddb0a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:16 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-32786abe-f8f2-4994-9955-61cb75a13e0d req-fa573cc9-d1da-4022-84a0-37ec6f574dc1 tempest-VolumesGetTestJSON-662589590 None] Acquiring lock "cinder-quobyte-3b7a57bd-d22f-4db6-866f-28e2383ddb0a" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:16 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-32786abe-f8f2-4994-9955-61cb75a13e0d req-fa573cc9-d1da-4022-84a0-37ec6f574dc1 tempest-VolumesGetTestJSON-662589590 None] Lock "cinder-quobyte-3b7a57bd-d22f-4db6-866f-28e2383ddb0a" acquired by "delete_volume" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:16 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca7f673-7772-4d06-bc2d-16471199febf]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-32786abe-f8f2-4994-9955-61cb75a13e0d req-fa573cc9-d1da-4022-84a0-37ec6f574dc1 tempest-VolumesGetTestJSON-662589590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b7a57bd-d22f-4db6-866f-28e2383ddb0a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:16 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3bac220d-d4dc-4f4b-88a6-14a9e244b974" returned: 0 in 0.393s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:47:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:16 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b7a57bd-d22f-4db6-866f-28e2383ddb0a Nov 05 03:47:16 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3911d67b-995d-4f2b-99f2-17568764deea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bac220d-d4dc-4f4b-88a6-14a9e244b974', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8b21fb1-1286-4aad-b0b5-2fe721fdb465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:16 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Volume volume-3bac220d-d4dc-4f4b-88a6-14a9e244b974 (3bac220d-d4dc-4f4b-88a6-14a9e244b974): created successfully Nov 05 03:47:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8b21fb1-1286-4aad-b0b5-2fe721fdb465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Flow 'volume_create_manager' (2220376f-7b34-4143-8640-bf91308b0127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:16 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-8d3780c0-944b-4cab-a2d3-e5562ff12bda tempest-VolumesTestJSON-1620751312 None] Created volume successfully. Nov 05 03:47:16 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-32786abe-f8f2-4994-9955-61cb75a13e0d req-fa573cc9-d1da-4022-84a0-37ec6f574dc1 tempest-VolumesGetTestJSON-662589590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b7a57bd-d22f-4db6-866f-28e2383ddb0a" returned: 0 in 0.464s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-32786abe-f8f2-4994-9955-61cb75a13e0d req-fa573cc9-d1da-4022-84a0-37ec6f574dc1 tempest-VolumesGetTestJSON-662589590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b7a57bd-d22f-4db6-866f-28e2383ddb0a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:16 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b7a57bd-d22f-4db6-866f-28e2383ddb0a Nov 05 03:47:16 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:17 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-32786abe-f8f2-4994-9955-61cb75a13e0d req-fa573cc9-d1da-4022-84a0-37ec6f574dc1 tempest-VolumesGetTestJSON-662589590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b7a57bd-d22f-4db6-866f-28e2383ddb0a" returned: 0 in 0.268s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-32786abe-f8f2-4994-9955-61cb75a13e0d req-fa573cc9-d1da-4022-84a0-37ec6f574dc1 tempest-VolumesGetTestJSON-662589590 None] Lock "cinder-quobyte-3b7a57bd-d22f-4db6-866f-28e2383ddb0a" released by "delete_volume" :: held 0.799s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.quota [req-32786abe-f8f2-4994-9955-61cb75a13e0d req-fa573cc9-d1da-4022-84a0-37ec6f574dc1 tempest-VolumesGetTestJSON-662589590 None] Created reservations ['6c972831-83ce-49cf-b06a-96f7d51a0b7e', '47aa8336-0f79-487b-93a4-13ad44af0de3', '075437e3-3020-4cb5-9bbf-ecff4eb657c3', '5a6b5a52-1778-486a-a4fc-a950cd4227ec'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-32786abe-f8f2-4994-9955-61cb75a13e0d req-fa573cc9-d1da-4022-84a0-37ec6f574dc1 tempest-VolumesGetTestJSON-662589590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-32786abe-f8f2-4994-9955-61cb75a13e0d req-fa573cc9-d1da-4022-84a0-37ec6f574dc1 tempest-VolumesGetTestJSON-662589590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [req-32786abe-f8f2-4994-9955-61cb75a13e0d req-fa573cc9-d1da-4022-84a0-37ec6f574dc1 tempest-VolumesGetTestJSON-662589590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [req-32786abe-f8f2-4994-9955-61cb75a13e0d req-fa573cc9-d1da-4022-84a0-37ec6f574dc1 tempest-VolumesGetTestJSON-662589590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-32786abe-f8f2-4994-9955-61cb75a13e0d req-fa573cc9-d1da-4022-84a0-37ec6f574dc1 tempest-VolumesGetTestJSON-662589590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-32786abe-f8f2-4994-9955-61cb75a13e0d req-fa573cc9-d1da-4022-84a0-37ec6f574dc1 tempest-VolumesGetTestJSON-662589590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:17 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:47:17 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Flow 'volume_create_manager' (b6930780-07a5-46a6-bce8-b1fa1efb4e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6991f1c1-ca49-4250-b59d-1b53aad5db62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6991f1c1-ca49-4250-b59d-1b53aad5db62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-348351208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee61c234-7083-48dc-9c40-b5af7b5ff41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='373214d369d84a14b965ecbceaa82df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:18Z,use_quota=True,user_id='e53e03db77614d219e8b8fab5e130081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d90991c-8589-497d-8ed6-d4b7c5e37ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d90991c-8589-497d-8ed6-d4b7c5e37ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666c4fc9-2c54-432d-83ea-256981cc0949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666c4fc9-2c54-432d-83ea-256981cc0949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee61c234-7083-48dc-9c40-b5af7b5ff41f', 'volume_name': 'volume-ee61c234-7083-48dc-9c40-b5af7b5ff41f', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bfa95c9-7c75-4ada-8d6c-f7bd727d905f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bfa95c9-7c75-4ada-8d6c-f7bd727d905f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c70222f6-e45c-424c-bda1-82737f24ad19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:17 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Volume ee61c234-7083-48dc-9c40-b5af7b5ff41f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee61c234-7083-48dc-9c40-b5af7b5ff41f', 'volume_size': 1} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-348351208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee61c234-7083-48dc-9c40-b5af7b5ff41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='373214d369d84a14b965ecbceaa82df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:18Z,use_quota=True,user_id='e53e03db77614d219e8b8fab5e130081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Creating volume ee61c234-7083-48dc-9c40-b5af7b5ff41f {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:47:17 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ee61c234-7083-48dc-9c40-b5af7b5ff41f 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:17 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ee61c234-7083-48dc-9c40-b5af7b5ff41f 1073741824 Nov 05 03:47:17 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:17 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-32786abe-f8f2-4994-9955-61cb75a13e0d req-fa573cc9-d1da-4022-84a0-37ec6f574dc1 tempest-VolumesGetTestJSON-662589590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.450s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.manager [req-32786abe-f8f2-4994-9955-61cb75a13e0d req-fa573cc9-d1da-4022-84a0-37ec6f574dc1 tempest-VolumesGetTestJSON-662589590 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:47:17 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-32786abe-f8f2-4994-9955-61cb75a13e0d req-fa573cc9-d1da-4022-84a0-37ec6f574dc1 tempest-VolumesGetTestJSON-662589590 None] Deleted volume successfully. Nov 05 03:47:17 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-32786abe-f8f2-4994-9955-61cb75a13e0d req-fa573cc9-d1da-4022-84a0-37ec6f574dc1 tempest-VolumesGetTestJSON-662589590 None] Lock "cinder-3b7a57bd-d22f-4db6-866f-28e2383ddb0a-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:18 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ee61c234-7083-48dc-9c40-b5af7b5ff41f 1073741824" returned: 0 in 0.695s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Flow 'volume_create_manager' (8276c946-1178-4606-9d2e-c7ad1778a6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a3ffda-f5cb-48ff-a441-8c4dc094ee92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a3ffda-f5cb-48ff-a441-8c4dc094ee92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-331918044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ea2dd3649d8475bbf2e8c4b6b8f19ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:18Z,use_quota=True,user_id='1954bc8fd89545bba4e8e07bbea61e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460b091c-6de5-4448-9ea1-ed0db9b6ac25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460b091c-6de5-4448-9ea1-ed0db9b6ac25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec596ac-51f1-488e-8c86-5f34692bb61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec596ac-51f1-488e-8c86-5f34692bb61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e', 'volume_name': 'volume-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a81c869-35ec-4f89-a434-ef38e8d1accf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a81c869-35ec-4f89-a434-ef38e8d1accf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834ca134-2505-42a3-9880-c57648593867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:18 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Volume 9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e', 'volume_size': 1} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ee61c234-7083-48dc-9c40-b5af7b5ff41f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:18 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ee61c234-7083-48dc-9c40-b5af7b5ff41f Nov 05 03:47:18 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:18 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ee61c234-7083-48dc-9c40-b5af7b5ff41f" returned: 0 in 0.274s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.285s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-331918044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ea2dd3649d8475bbf2e8c4b6b8f19ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:18Z,use_quota=True,user_id='1954bc8fd89545bba4e8e07bbea61e36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Creating volume 9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:47:18 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c70222f6-e45c-424c-bda1-82737f24ad19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee61c234-7083-48dc-9c40-b5af7b5ff41f', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fad449ab-9292-464c-a3e3-a798ecdd1770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:18 devstack sudo[94444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e 1073741824 Nov 05 03:47:18 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:18 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Volume volume-ee61c234-7083-48dc-9c40-b5af7b5ff41f (ee61c234-7083-48dc-9c40-b5af7b5ff41f): created successfully Nov 05 03:47:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fad449ab-9292-464c-a3e3-a798ecdd1770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Flow 'volume_create_manager' (b6930780-07a5-46a6-bce8-b1fa1efb4e7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:19 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5be6bbe2-2043-4144-bd97-7b3688b15f9a tempest-VolumesTransfersV355Test-1919728882 None] Created volume successfully. Nov 05 03:47:19 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e 1073741824" returned: 0 in 0.641s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:19 devstack sudo[94452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e Nov 05 03:47:19 devstack sudo[94452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:19 devstack sudo[94452]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e" returned: 0 in 0.342s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:47:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (834ca134-2505-42a3-9880-c57648593867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a95d55-7360-4c97-86bb-f17290a8ff74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:20 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Volume volume-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e (9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e): created successfully Nov 05 03:47:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a95d55-7360-4c97-86bb-f17290a8ff74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Flow 'volume_create_manager' (8276c946-1178-4606-9d2e-c7ad1778a6e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:20 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-544d325f-d715-4a4e-b9e1-16ab73066af1 tempest-VolumesTestJSON-1620751312 None] Created volume successfully. Nov 05 03:47:20 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-10ebccf1-a7b6-4f15-bef4-e54de62a55f6 tempest-VolumesTransfersV355Test-1099002256 None] Transfer volume completed successfully. Nov 05 03:47:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bf85940c-d54c-4a1d-bac9-e94d34c65bb2 tempest-VolumesTransfersV355Test-363095882 None] Acquiring lock "cinder-ee61c234-7083-48dc-9c40-b5af7b5ff41f-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bf85940c-d54c-4a1d-bac9-e94d34c65bb2 tempest-VolumesTransfersV355Test-363095882 None] Lock "cinder-ee61c234-7083-48dc-9c40-b5af7b5ff41f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bf85940c-d54c-4a1d-bac9-e94d34c65bb2 tempest-VolumesTransfersV355Test-363095882 None] Acquiring lock "cinder-quobyte-ee61c234-7083-48dc-9c40-b5af7b5ff41f" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bf85940c-d54c-4a1d-bac9-e94d34c65bb2 tempest-VolumesTransfersV355Test-363095882 None] Lock "cinder-quobyte-ee61c234-7083-48dc-9c40-b5af7b5ff41f" acquired by "delete_volume" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b49b8f15-50fd-42b9-910b-54549daa7ec4 tempest-VolumesTestJSON-1620751312 None] Acquiring lock "cinder-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:22 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e50dc2-1c49-4f1d-a308-dbd19f8d6d2c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bf85940c-d54c-4a1d-bac9-e94d34c65bb2 tempest-VolumesTransfersV355Test-363095882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ee61c234-7083-48dc-9c40-b5af7b5ff41f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b49b8f15-50fd-42b9-910b-54549daa7ec4 tempest-VolumesTestJSON-1620751312 None] Lock "cinder-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b49b8f15-50fd-42b9-910b-54549daa7ec4 tempest-VolumesTestJSON-1620751312 None] Acquiring lock "cinder-quobyte-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b49b8f15-50fd-42b9-910b-54549daa7ec4 tempest-VolumesTestJSON-1620751312 None] Lock "cinder-quobyte-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e" acquired by "delete_volume" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:22 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c94c79-c0bf-48a2-8f3b-487cb034f54c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b49b8f15-50fd-42b9-910b-54549daa7ec4 tempest-VolumesTestJSON-1620751312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:22 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ee61c234-7083-48dc-9c40-b5af7b5ff41f Nov 05 03:47:22 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:22 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e Nov 05 03:47:22 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:22 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bf85940c-d54c-4a1d-bac9-e94d34c65bb2 tempest-VolumesTransfersV355Test-363095882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ee61c234-7083-48dc-9c40-b5af7b5ff41f" returned: 0 in 0.526s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bf85940c-d54c-4a1d-bac9-e94d34c65bb2 tempest-VolumesTransfersV355Test-363095882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ee61c234-7083-48dc-9c40-b5af7b5ff41f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:22 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ee61c234-7083-48dc-9c40-b5af7b5ff41f Nov 05 03:47:22 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:22 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b49b8f15-50fd-42b9-910b-54549daa7ec4 tempest-VolumesTestJSON-1620751312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e" returned: 0 in 0.474s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b49b8f15-50fd-42b9-910b-54549daa7ec4 tempest-VolumesTestJSON-1620751312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:22 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e Nov 05 03:47:22 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:22 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bf85940c-d54c-4a1d-bac9-e94d34c65bb2 tempest-VolumesTransfersV355Test-363095882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ee61c234-7083-48dc-9c40-b5af7b5ff41f" returned: 0 in 0.354s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bf85940c-d54c-4a1d-bac9-e94d34c65bb2 tempest-VolumesTransfersV355Test-363095882 None] Lock "cinder-quobyte-ee61c234-7083-48dc-9c40-b5af7b5ff41f" released by "delete_volume" :: held 1.014s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-bf85940c-d54c-4a1d-bac9-e94d34c65bb2 tempest-VolumesTransfersV355Test-363095882 None] Created reservations ['2c2f9517-f747-4705-8710-7cf0742b4205', 'c2d773b2-9f8f-4774-9cf3-ea2780107fb3', 'cb6481fe-a925-44d8-8fdd-d189f4876eae', 'e8c30b7f-06e6-4959-b350-e00fada492d7'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:47:23 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b49b8f15-50fd-42b9-910b-54549daa7ec4 tempest-VolumesTestJSON-1620751312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e" returned: 0 in 0.499s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b49b8f15-50fd-42b9-910b-54549daa7ec4 tempest-VolumesTestJSON-1620751312 None] Lock "cinder-quobyte-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e" released by "delete_volume" :: held 1.032s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bf85940c-d54c-4a1d-bac9-e94d34c65bb2 tempest-VolumesTransfersV355Test-363095882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bf85940c-d54c-4a1d-bac9-e94d34c65bb2 tempest-VolumesTransfersV355Test-363095882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-bf85940c-d54c-4a1d-bac9-e94d34c65bb2 tempest-VolumesTransfersV355Test-363095882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-bf85940c-d54c-4a1d-bac9-e94d34c65bb2 tempest-VolumesTransfersV355Test-363095882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bf85940c-d54c-4a1d-bac9-e94d34c65bb2 tempest-VolumesTransfersV355Test-363095882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bf85940c-d54c-4a1d-bac9-e94d34c65bb2 tempest-VolumesTransfersV355Test-363095882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-b49b8f15-50fd-42b9-910b-54549daa7ec4 tempest-VolumesTestJSON-1620751312 None] Created reservations ['1a268e52-afb0-4a57-9b72-05f67146c8c7', '5110bf93-9cc8-47d7-9a3d-ba2bc15bb6e0', '82ad1804-74f9-449e-8e82-10038328006b', '2d04db06-aadc-4ff4-a701-05a2d27eb4ae'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:47:23 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:47:23 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b49b8f15-50fd-42b9-910b-54549daa7ec4 tempest-VolumesTestJSON-1620751312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b49b8f15-50fd-42b9-910b-54549daa7ec4 tempest-VolumesTestJSON-1620751312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b49b8f15-50fd-42b9-910b-54549daa7ec4 tempest-VolumesTestJSON-1620751312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b49b8f15-50fd-42b9-910b-54549daa7ec4 tempest-VolumesTestJSON-1620751312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b49b8f15-50fd-42b9-910b-54549daa7ec4 tempest-VolumesTestJSON-1620751312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b49b8f15-50fd-42b9-910b-54549daa7ec4 tempest-VolumesTestJSON-1620751312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:23 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:47:23 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:23 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bf85940c-d54c-4a1d-bac9-e94d34c65bb2 tempest-VolumesTransfersV355Test-363095882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.405s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-bf85940c-d54c-4a1d-bac9-e94d34c65bb2 tempest-VolumesTransfersV355Test-363095882 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:47:23 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-bf85940c-d54c-4a1d-bac9-e94d34c65bb2 tempest-VolumesTransfersV355Test-363095882 None] Deleted volume successfully. Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bf85940c-d54c-4a1d-bac9-e94d34c65bb2 tempest-VolumesTransfersV355Test-363095882 None] Lock "cinder-ee61c234-7083-48dc-9c40-b5af7b5ff41f-delete_volume" released by "delete_volume" :: held 1.842s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:23 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b49b8f15-50fd-42b9-910b-54549daa7ec4 tempest-VolumesTestJSON-1620751312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.372s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-b49b8f15-50fd-42b9-910b-54549daa7ec4 tempest-VolumesTestJSON-1620751312 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:47:23 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b49b8f15-50fd-42b9-910b-54549daa7ec4 tempest-VolumesTestJSON-1620751312 None] Deleted volume successfully. Nov 05 03:47:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b49b8f15-50fd-42b9-910b-54549daa7ec4 tempest-VolumesTestJSON-1620751312 None] Lock "cinder-9a8ef6df-5f1e-40c4-a21a-1a415a2bfb0e-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3f0ace24-ea0a-4024-9f5c-9491b58e153d tempest-VolumesTestJSON-1620751312 None] Acquiring lock "cinder-3bac220d-d4dc-4f4b-88a6-14a9e244b974-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3f0ace24-ea0a-4024-9f5c-9491b58e153d tempest-VolumesTestJSON-1620751312 None] Lock "cinder-3bac220d-d4dc-4f4b-88a6-14a9e244b974-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3f0ace24-ea0a-4024-9f5c-9491b58e153d tempest-VolumesTestJSON-1620751312 None] Acquiring lock "cinder-quobyte-3bac220d-d4dc-4f4b-88a6-14a9e244b974" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3f0ace24-ea0a-4024-9f5c-9491b58e153d tempest-VolumesTestJSON-1620751312 None] Lock "cinder-quobyte-3bac220d-d4dc-4f4b-88a6-14a9e244b974" acquired by "delete_volume" :: waited 0.031s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:24 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb98885-efd6-44ef-bc63-5d39462d9c8f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3f0ace24-ea0a-4024-9f5c-9491b58e153d tempest-VolumesTestJSON-1620751312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3bac220d-d4dc-4f4b-88a6-14a9e244b974 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:24 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3bac220d-d4dc-4f4b-88a6-14a9e244b974 Nov 05 03:47:24 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:24 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:47:24 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Flow 'volume_create_manager' (bd742553-18ae-4438-a2d2-f710ab5435b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:24 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fca6537-3dc9-4735-ae76-71948015b30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fca6537-3dc9-4735-ae76-71948015b30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-809387000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f5ada7-3693-492d-83ae-e175b2da14f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='373214d369d84a14b965ecbceaa82df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:25Z,use_quota=True,user_id='e53e03db77614d219e8b8fab5e130081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8770f4d-080d-4e88-8fc2-e3141351981d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8770f4d-080d-4e88-8fc2-e3141351981d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b46b29-cff7-4022-a7a7-aa99c22f8de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b46b29-cff7-4022-a7a7-aa99c22f8de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5f5ada7-3693-492d-83ae-e175b2da14f9', 'volume_name': 'volume-b5f5ada7-3693-492d-83ae-e175b2da14f9', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25108f1f-38d4-445d-8e4d-9d937e9d0549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25108f1f-38d4-445d-8e4d-9d937e9d0549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7891791-c253-4065-901f-a28b551c6217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:25 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Volume b5f5ada7-3693-492d-83ae-e175b2da14f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5f5ada7-3693-492d-83ae-e175b2da14f9', 'volume_size': 1} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-809387000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5f5ada7-3693-492d-83ae-e175b2da14f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='373214d369d84a14b965ecbceaa82df3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:25Z,use_quota=True,user_id='e53e03db77614d219e8b8fab5e130081',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Creating volume b5f5ada7-3693-492d-83ae-e175b2da14f9 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:47:25 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b5f5ada7-3693-492d-83ae-e175b2da14f9 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:25 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b5f5ada7-3693-492d-83ae-e175b2da14f9 1073741824 Nov 05 03:47:25 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:25 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3f0ace24-ea0a-4024-9f5c-9491b58e153d tempest-VolumesTestJSON-1620751312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3bac220d-d4dc-4f4b-88a6-14a9e244b974" returned: 0 in 0.626s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3f0ace24-ea0a-4024-9f5c-9491b58e153d tempest-VolumesTestJSON-1620751312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3bac220d-d4dc-4f4b-88a6-14a9e244b974 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:25 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3bac220d-d4dc-4f4b-88a6-14a9e244b974 Nov 05 03:47:25 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:25 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3f0ace24-ea0a-4024-9f5c-9491b58e153d tempest-VolumesTestJSON-1620751312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3bac220d-d4dc-4f4b-88a6-14a9e244b974" returned: 0 in 0.338s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3f0ace24-ea0a-4024-9f5c-9491b58e153d tempest-VolumesTestJSON-1620751312 None] Lock "cinder-quobyte-3bac220d-d4dc-4f4b-88a6-14a9e244b974" released by "delete_volume" :: held 1.043s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-3f0ace24-ea0a-4024-9f5c-9491b58e153d tempest-VolumesTestJSON-1620751312 None] Created reservations ['8ab358a7-3ffb-4510-99e9-2d6d4cc60a29', '9b4c50d9-21d7-49f6-b829-3ced0be8af62', '29544e6b-a409-4bf5-a496-1ef0183d07d3', 'a7233785-fea9-4e7c-af66-2023b95884a7'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3f0ace24-ea0a-4024-9f5c-9491b58e153d tempest-VolumesTestJSON-1620751312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3f0ace24-ea0a-4024-9f5c-9491b58e153d tempest-VolumesTestJSON-1620751312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3f0ace24-ea0a-4024-9f5c-9491b58e153d tempest-VolumesTestJSON-1620751312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3f0ace24-ea0a-4024-9f5c-9491b58e153d tempest-VolumesTestJSON-1620751312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3f0ace24-ea0a-4024-9f5c-9491b58e153d tempest-VolumesTestJSON-1620751312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3f0ace24-ea0a-4024-9f5c-9491b58e153d tempest-VolumesTestJSON-1620751312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:25 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:47:25 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:25 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b5f5ada7-3693-492d-83ae-e175b2da14f9 1073741824" returned: 0 in 0.736s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b5f5ada7-3693-492d-83ae-e175b2da14f9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:25 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b5f5ada7-3693-492d-83ae-e175b2da14f9 Nov 05 03:47:25 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:26 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3f0ace24-ea0a-4024-9f5c-9491b58e153d tempest-VolumesTestJSON-1620751312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.413s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:26 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-3f0ace24-ea0a-4024-9f5c-9491b58e153d tempest-VolumesTestJSON-1620751312 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:47:26 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-3f0ace24-ea0a-4024-9f5c-9491b58e153d tempest-VolumesTestJSON-1620751312 None] Deleted volume successfully. Nov 05 03:47:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3f0ace24-ea0a-4024-9f5c-9491b58e153d tempest-VolumesTestJSON-1620751312 None] Lock "cinder-3bac220d-d4dc-4f4b-88a6-14a9e244b974-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:26 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b5f5ada7-3693-492d-83ae-e175b2da14f9" returned: 0 in 0.385s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:47:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:26 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7891791-c253-4065-901f-a28b551c6217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5f5ada7-3693-492d-83ae-e175b2da14f9', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:26 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce4d3da-c05a-48c6-a060-571e492c4f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:26 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Volume volume-b5f5ada7-3693-492d-83ae-e175b2da14f9 (b5f5ada7-3693-492d-83ae-e175b2da14f9): created successfully Nov 05 03:47:26 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce4d3da-c05a-48c6-a060-571e492c4f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:26 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Flow 'volume_create_manager' (bd742553-18ae-4438-a2d2-f710ab5435b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:26 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-23ef0dea-d537-4d9c-8711-60dabfd659d1 tempest-VolumesTransfersV355Test-1919728882 None] Created volume successfully. Nov 05 03:47:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-981ca8d3-2c02-432e-a284-7aebcb3f9dac tempest-VolumesTestJSON-1620751312 None] Acquiring lock "cinder-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-981ca8d3-2c02-432e-a284-7aebcb3f9dac tempest-VolumesTestJSON-1620751312 None] Lock "cinder-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-981ca8d3-2c02-432e-a284-7aebcb3f9dac tempest-VolumesTestJSON-1620751312 None] Acquiring lock "cinder-quobyte-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-981ca8d3-2c02-432e-a284-7aebcb3f9dac tempest-VolumesTestJSON-1620751312 None] Lock "cinder-quobyte-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe" acquired by "delete_volume" :: waited 0.030s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:26 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda75b08-3c16-4c05-a7a0-5ab74f173274]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-981ca8d3-2c02-432e-a284-7aebcb3f9dac tempest-VolumesTestJSON-1620751312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:27 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe Nov 05 03:47:27 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:27 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-981ca8d3-2c02-432e-a284-7aebcb3f9dac tempest-VolumesTestJSON-1620751312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe" returned: 0 in 0.538s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-981ca8d3-2c02-432e-a284-7aebcb3f9dac tempest-VolumesTestJSON-1620751312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bac86efb-a494-4897-a526-3fc70ecaf04d tempest-VolumesTransfersV355Test-363095882 None] Acquiring lock "cinder-b5f5ada7-3693-492d-83ae-e175b2da14f9-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:27 devstack sudo[94505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe Nov 05 03:47:27 devstack sudo[94505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bac86efb-a494-4897-a526-3fc70ecaf04d tempest-VolumesTransfersV355Test-363095882 None] Lock "cinder-b5f5ada7-3693-492d-83ae-e175b2da14f9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bac86efb-a494-4897-a526-3fc70ecaf04d tempest-VolumesTransfersV355Test-363095882 None] Acquiring lock "cinder-quobyte-b5f5ada7-3693-492d-83ae-e175b2da14f9" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bac86efb-a494-4897-a526-3fc70ecaf04d tempest-VolumesTransfersV355Test-363095882 None] Lock "cinder-quobyte-b5f5ada7-3693-492d-83ae-e175b2da14f9" acquired by "delete_volume" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:27 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa5ae74-64e5-4764-aaed-8877e0e3d210]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bac86efb-a494-4897-a526-3fc70ecaf04d tempest-VolumesTransfersV355Test-363095882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b5f5ada7-3693-492d-83ae-e175b2da14f9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:27 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b5f5ada7-3693-492d-83ae-e175b2da14f9 Nov 05 03:47:27 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:27 devstack sudo[94505]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-981ca8d3-2c02-432e-a284-7aebcb3f9dac tempest-VolumesTestJSON-1620751312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe" returned: 0 in 0.406s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-981ca8d3-2c02-432e-a284-7aebcb3f9dac tempest-VolumesTestJSON-1620751312 None] Lock "cinder-quobyte-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe" released by "delete_volume" :: held 1.015s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:28 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-981ca8d3-2c02-432e-a284-7aebcb3f9dac tempest-VolumesTestJSON-1620751312 None] Created reservations ['a106b9be-46e1-4f27-9dae-1a8ad15389de', '9c22fe9a-5983-4a0a-91c6-e8dcd5a8dbd9', 'c66548fb-661e-4ab7-b540-91a6ece2e041', '44dfe414-a165-4a46-96b9-08ac6a661fc6'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:47:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-981ca8d3-2c02-432e-a284-7aebcb3f9dac tempest-VolumesTestJSON-1620751312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-981ca8d3-2c02-432e-a284-7aebcb3f9dac tempest-VolumesTestJSON-1620751312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:28 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-981ca8d3-2c02-432e-a284-7aebcb3f9dac tempest-VolumesTestJSON-1620751312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:28 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-981ca8d3-2c02-432e-a284-7aebcb3f9dac tempest-VolumesTestJSON-1620751312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-981ca8d3-2c02-432e-a284-7aebcb3f9dac tempest-VolumesTestJSON-1620751312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-981ca8d3-2c02-432e-a284-7aebcb3f9dac tempest-VolumesTestJSON-1620751312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:28 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:47:28 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:28 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bac86efb-a494-4897-a526-3fc70ecaf04d tempest-VolumesTransfersV355Test-363095882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b5f5ada7-3693-492d-83ae-e175b2da14f9" returned: 0 in 0.580s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bac86efb-a494-4897-a526-3fc70ecaf04d tempest-VolumesTransfersV355Test-363095882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b5f5ada7-3693-492d-83ae-e175b2da14f9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:28 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b5f5ada7-3693-492d-83ae-e175b2da14f9 Nov 05 03:47:28 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:28 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-981ca8d3-2c02-432e-a284-7aebcb3f9dac tempest-VolumesTestJSON-1620751312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.305s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:28 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-981ca8d3-2c02-432e-a284-7aebcb3f9dac tempest-VolumesTestJSON-1620751312 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:47:28 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-981ca8d3-2c02-432e-a284-7aebcb3f9dac tempest-VolumesTestJSON-1620751312 None] Deleted volume successfully. Nov 05 03:47:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-981ca8d3-2c02-432e-a284-7aebcb3f9dac tempest-VolumesTestJSON-1620751312 None] Lock "cinder-ff2181cf-dedc-4df3-943b-bdb4c2c9d7fe-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:28 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bac86efb-a494-4897-a526-3fc70ecaf04d tempest-VolumesTransfersV355Test-363095882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b5f5ada7-3693-492d-83ae-e175b2da14f9" returned: 0 in 0.339s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bac86efb-a494-4897-a526-3fc70ecaf04d tempest-VolumesTransfersV355Test-363095882 None] Lock "cinder-quobyte-b5f5ada7-3693-492d-83ae-e175b2da14f9" released by "delete_volume" :: held 0.977s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:28 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-bac86efb-a494-4897-a526-3fc70ecaf04d tempest-VolumesTransfersV355Test-363095882 None] Created reservations ['0b8ba0ed-5c2c-41c4-ac23-26ea8e4a34cf', 'f0fb9120-df7e-4571-9a31-f81db10291d7', '14c2e32a-0abb-4b97-a378-446483b21497', '7bb3dc95-a145-4aec-889c-8ab5dd97a85d'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:47:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bac86efb-a494-4897-a526-3fc70ecaf04d tempest-VolumesTransfersV355Test-363095882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bac86efb-a494-4897-a526-3fc70ecaf04d tempest-VolumesTransfersV355Test-363095882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:28 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-bac86efb-a494-4897-a526-3fc70ecaf04d tempest-VolumesTransfersV355Test-363095882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:28 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-bac86efb-a494-4897-a526-3fc70ecaf04d tempest-VolumesTransfersV355Test-363095882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bac86efb-a494-4897-a526-3fc70ecaf04d tempest-VolumesTransfersV355Test-363095882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bac86efb-a494-4897-a526-3fc70ecaf04d tempest-VolumesTransfersV355Test-363095882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:28 devstack sudo[94520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:47:28 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:29 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bac86efb-a494-4897-a526-3fc70ecaf04d tempest-VolumesTransfersV355Test-363095882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.352s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:29 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-bac86efb-a494-4897-a526-3fc70ecaf04d tempest-VolumesTransfersV355Test-363095882 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:47:29 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-bac86efb-a494-4897-a526-3fc70ecaf04d tempest-VolumesTransfersV355Test-363095882 None] Deleted volume successfully. Nov 05 03:47:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bac86efb-a494-4897-a526-3fc70ecaf04d tempest-VolumesTransfersV355Test-363095882 None] Lock "cinder-b5f5ada7-3693-492d-83ae-e175b2da14f9-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:29 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-12ab32a1-5cc5-4b93-9dac-3a27ff04462c tempest-GroupSnapshotsTest-2038618516 None] Group tempest-GroupSnapshotsTest-Group-1496600421: creating Nov 05 03:47:29 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-12ab32a1-5cc5-4b93-9dac-3a27ff04462c tempest-GroupSnapshotsTest-2038618516 None] Group tempest-GroupSnapshotsTest-Group-1496600421: created successfully Nov 05 03:47:29 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-12ab32a1-5cc5-4b93-9dac-3a27ff04462c tempest-GroupSnapshotsTest-2038618516 None] Create group completed successfully. Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Flow 'volume_create_manager' (494f0342-e6c3-44ea-9fd6-41e1fc85fbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eabb663-860f-4907-b957-469aa6a839cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eabb663-860f-4907-b957-469aa6a839cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2133724912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be89b23c-f0d6-466b-894a-a71451c2832e,host='devstack@QuobyteHD#QuobyteHD',id=c5e0a233-e7ea-4662-91a0-efbdf3d223b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e6c5a7667746f0ab624a89056f8f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:31Z,use_quota=True,user_id='2d7901c53bf34805ba08c6d7d5704bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10bbc9fa-7506-4ac7-be90-db880bbc4c8d),volume_type_id=10bbc9fa-7506-4ac7-be90-db880bbc4c8d)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca88660-9c19-4c73-8c5b-330a92312b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca88660-9c19-4c73-8c5b-330a92312b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019de812-66aa-450d-bc8c-c348f4c98984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019de812-66aa-450d-bc8c-c348f4c98984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5e0a233-e7ea-4662-91a0-efbdf3d223b8', 'volume_name': 'volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5f7450-785c-49b8-983b-3cc45de1c128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5f7450-785c-49b8-983b-3cc45de1c128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b078d5c-ae10-45c6-930c-56c607f1ea2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:31 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Volume c5e0a233-e7ea-4662-91a0-efbdf3d223b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8', 'volume_size': 1} Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=be89b23c-f0d6-466b-894a-a71451c2832e,created_at=2026-11-05T02:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2133724912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be89b23c-f0d6-466b-894a-a71451c2832e,host='devstack@QuobyteHD#QuobyteHD',id=c5e0a233-e7ea-4662-91a0-efbdf3d223b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e6c5a7667746f0ab624a89056f8f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:31Z,use_quota=True,user_id='2d7901c53bf34805ba08c6d7d5704bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10bbc9fa-7506-4ac7-be90-db880bbc4c8d),volume_type_id=10bbc9fa-7506-4ac7-be90-db880bbc4c8d)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Creating volume c5e0a233-e7ea-4662-91a0-efbdf3d223b8 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:47:31 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:47:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:31 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 1073741824 Nov 05 03:47:31 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:32 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 1073741824" returned: 0 in 0.615s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:32 devstack sudo[94528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 Nov 05 03:47:32 devstack sudo[94528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:32 devstack sudo[94528]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8" returned: 0 in 0.311s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:47:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b078d5c-ae10-45c6-930c-56c607f1ea2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee53d5b-0ed0-4688-84a6-5fd66a683cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:32 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Volume volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 (c5e0a233-e7ea-4662-91a0-efbdf3d223b8): created successfully Nov 05 03:47:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee53d5b-0ed0-4688-84a6-5fd66a683cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Flow 'volume_create_manager' (494f0342-e6c3-44ea-9fd6-41e1fc85fbbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:32 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-3213743b-8476-4153-9b88-9f70197dbe29 tempest-GroupSnapshotsTest-2038618516 None] Created volume successfully. Nov 05 03:47:33 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f9bfa034-e9df-4423-84b0-9cd7ff5a03cb tempest-GroupSnapshotsTest-2038618516 None] GroupSnapshot 068e6c6c-20e6-4270-80ec-5b9b91127d13: creating. Nov 05 03:47:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f9bfa034-e9df-4423-84b0-9cd7ff5a03cb tempest-GroupSnapshotsTest-2038618516 None] Group snapshot 068e6c6c-20e6-4270-80ec-5b9b91127d13: creating. {{(pid=87109) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4196}} Nov 05 03:47:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f9bfa034-e9df-4423-84b0-9cd7ff5a03cb tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f9bfa034-e9df-4423-84b0-9cd7ff5a03cb tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f9bfa034-e9df-4423-84b0-9cd7ff5a03cb tempest-GroupSnapshotsTest-2038618516 None] Creating offline snapshot e8d2e574-aded-4516-b4b0-74e9db0eea80 of volume c5e0a233-e7ea-4662-91a0-efbdf3d223b8 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:47:33 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[75629f80-60d2-4e9f-ade6-77059e4eaed0]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f9bfa034-e9df-4423-84b0-9cd7ff5a03cb tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:33 devstack sudo[94531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 Nov 05 03:47:33 devstack sudo[94531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:33 devstack sudo[94531]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f9bfa034-e9df-4423-84b0-9cd7ff5a03cb tempest-GroupSnapshotsTest-2038618516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8" returned: 0 in 0.467s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f9bfa034-e9df-4423-84b0-9cd7ff5a03cb tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:33 devstack sudo[94537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80 1G Nov 05 03:47:33 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:34 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f9bfa034-e9df-4423-84b0-9cd7ff5a03cb tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80 1G" returned: 0 in 0.595s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f9bfa034-e9df-4423-84b0-9cd7ff5a03cb tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:34 devstack sudo[94543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80 Nov 05 03:47:34 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:34 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f9bfa034-e9df-4423-84b0-9cd7ff5a03cb tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80" returned: 0 in 0.426s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:34 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-f9bfa034-e9df-4423-84b0-9cd7ff5a03cb tempest-GroupSnapshotsTest-2038618516 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:47:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f9bfa034-e9df-4423-84b0-9cd7ff5a03cb tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:34 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80 Nov 05 03:47:34 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:35 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f9bfa034-e9df-4423-84b0-9cd7ff5a03cb tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80" returned: 0 in 0.297s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f9bfa034-e9df-4423-84b0-9cd7ff5a03cb tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:35 devstack sudo[94552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.info Nov 05 03:47:35 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:35 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f9bfa034-e9df-4423-84b0-9cd7ff5a03cb tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.info" returned: 0 in 0.345s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:35 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-f9bfa034-e9df-4423-84b0-9cd7ff5a03cb tempest-GroupSnapshotsTest-2038618516 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:47:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f9bfa034-e9df-4423-84b0-9cd7ff5a03cb tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:35 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.info Nov 05 03:47:35 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:35 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f9bfa034-e9df-4423-84b0-9cd7ff5a03cb tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.info" returned: 0 in 0.358s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f9bfa034-e9df-4423-84b0-9cd7ff5a03cb tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.630s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:35 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f9bfa034-e9df-4423-84b0-9cd7ff5a03cb tempest-GroupSnapshotsTest-2038618516 None] group_snapshot 068e6c6c-20e6-4270-80ec-5b9b91127d13: created successfully Nov 05 03:47:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "cinder-quobyte-e8d2e574-aded-4516-b4b0-74e9db0eea80-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e" by "_create_volume_from_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-e8d2e574-aded-4516-b4b0-74e9db0eea80-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Creating volume e957f01c-8dd9-4bcb-b7c0-28dde7e3690e from snapshot e8d2e574-aded-4516-b4b0-74e9db0eea80 {{(pid=87109) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Nov 05 03:47:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:47:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "cinder-quobyte-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e" by "_copy_volume_from_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:38 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:38 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] snapshot: e8d2e574-aded-4516-b4b0-74e9db0eea80, volume: e957f01c-8dd9-4bcb-b7c0-28dde7e3690e, {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 03:47:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:38 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:38 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:38 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6048292-7182-4892-bddf-dd438438a996]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:38 devstack sudo[94566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80 Nov 05 03:47:38 devstack sudo[94566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:38 devstack sudo[94566]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80" returned: 0 in 0.613s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:38 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:47:38 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[429fb124-7731-44ef-b7dc-9033f40d48f6]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:38 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 Nov 05 03:47:38 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:39 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8" returned: 0 in 0.652s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 03:47:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Creating direct copy from snapshot {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 03:47:39 devstack cinder-volume[87109]: DEBUG cinder.utils [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Path /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e not found in is_blk_device check {{(pid=87109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 03:47:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:39 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e Nov 05 03:47:39 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:46 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:47:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Flow 'volume_create_manager' (9136fdef-2630-42c3-9314-93f47040a44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7995f836-a63c-4d53-9bf1-de73d8516319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7995f836-a63c-4d53-9bf1-de73d8516319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-224322395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=682e0735-eb4d-40ae-96cf-1aa33e8505a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782ea371ccd042ae9ba19887e499e42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:46Z,use_quota=True,user_id='8b69bb24ee5b4488b2c8946e12162601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0899726e-3f84-4969-ba53-4ae34238435b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0899726e-3f84-4969-ba53-4ae34238435b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf301f0-ddf8-40a2-8a40-027ff906d0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf301f0-ddf8-40a2-8a40-027ff906d0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '682e0735-eb4d-40ae-96cf-1aa33e8505a6', 'volume_name': 'volume-682e0735-eb4d-40ae-96cf-1aa33e8505a6', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85688b23-8329-4288-8650-3ffb0d1051e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85688b23-8329-4288-8650-3ffb0d1051e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9cbf43-f1ec-40dd-9e54-e1ba17b2e611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:46 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Volume 682e0735-eb4d-40ae-96cf-1aa33e8505a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-682e0735-eb4d-40ae-96cf-1aa33e8505a6', 'volume_size': 1} Nov 05 03:47:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:49 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:47:49 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Flow 'volume_create_manager' (d31e8b90-b3b4-4a25-86df-3f71b1b9cf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:49 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec0615c-0f1b-411f-abda-3a3967f1a4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec0615c-0f1b-411f-abda-3a3967f1a4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-144039256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a523f6a-ffb3-434c-b357-ee40630378fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d48ce44d8864576a6823873009ca05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:50Z,use_quota=True,user_id='db89d5be86fe436aba6c39855fe3157c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e734a7-b5be-4a27-9e04-9df11da82deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e734a7-b5be-4a27-9e04-9df11da82deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97fb915b-b8bd-4fa1-a2fc-ad51ba05d2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97fb915b-b8bd-4fa1-a2fc-ad51ba05d2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a523f6a-ffb3-434c-b357-ee40630378fc', 'volume_name': 'volume-0a523f6a-ffb3-434c-b357-ee40630378fc', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fefe9e1b-daa5-4683-94d7-95a23bca836d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fefe9e1b-daa5-4683-94d7-95a23bca836d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca64caa5-15a7-431b-946f-02d40ca0cc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:50 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Volume 0a523f6a-ffb3-434c-b357-ee40630378fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a523f6a-ffb3-434c-b357-ee40630378fc', 'volume_size': 1} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:50 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e" returned: 0 in 10.861s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Image conversion details: src /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8, size 1024.00 MB, duration 10.86 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:47:50 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Converted 1024.00 MB image at 94.28 MB/s Nov 05 03:47:50 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:50 devstack sudo[94676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e Nov 05 03:47:50 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:50 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e" returned: 0 in 0.278s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e" released by "_copy_volume_from_snapshot" :: held 12.561s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-e8d2e574-aded-4516-b4b0-74e9db0eea80-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e" released by "_create_volume_from_snapshot" :: held 12.699s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.728s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.288s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-224322395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=682e0735-eb4d-40ae-96cf-1aa33e8505a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782ea371ccd042ae9ba19887e499e42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:46Z,use_quota=True,user_id='8b69bb24ee5b4488b2c8946e12162601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Creating volume 682e0735-eb4d-40ae-96cf-1aa33e8505a6 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:47:50 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:47:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-682e0735-eb4d-40ae-96cf-1aa33e8505a6 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:50 devstack sudo[94680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-682e0735-eb4d-40ae-96cf-1aa33e8505a6 1073741824 Nov 05 03:47:50 devstack sudo[94680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:50 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-53bb9b2a-e9a9-4a79-86fe-d62f9ddf57f1 tempest-GroupSnapshotsTest-2038618516 None] Create group from source-snapshot-068e6c6c-20e6-4270-80ec-5b9b91127d13 completed successfully. Nov 05 03:47:51 devstack sudo[94680]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-682e0735-eb4d-40ae-96cf-1aa33e8505a6 1073741824" returned: 0 in 0.636s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-682e0735-eb4d-40ae-96cf-1aa33e8505a6 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:51 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-682e0735-eb4d-40ae-96cf-1aa33e8505a6 Nov 05 03:47:51 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:51 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-682e0735-eb4d-40ae-96cf-1aa33e8505a6" returned: 0 in 0.288s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:47:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.549s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-144039256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a523f6a-ffb3-434c-b357-ee40630378fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d48ce44d8864576a6823873009ca05f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:50Z,use_quota=True,user_id='db89d5be86fe436aba6c39855fe3157c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:47:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Creating volume 0a523f6a-ffb3-434c-b357-ee40630378fc {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:47:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:47:51 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:47:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df9cbf43-f1ec-40dd-9e54-e1ba17b2e611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-682e0735-eb4d-40ae-96cf-1aa33e8505a6', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:51 devstack sudo[94689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc 1073741824 Nov 05 03:47:51 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e201a3-1f8f-4784-8cc9-46dc81aeda9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:51 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Volume volume-682e0735-eb4d-40ae-96cf-1aa33e8505a6 (682e0735-eb4d-40ae-96cf-1aa33e8505a6): created successfully Nov 05 03:47:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e201a3-1f8f-4784-8cc9-46dc81aeda9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Flow 'volume_create_manager' (9136fdef-2630-42c3-9314-93f47040a44c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:51 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-e3c0ec84-b81f-443d-9620-c74b80ebc53b tempest-VolumesTransfersV357Test-2058767237 None] Created volume successfully. Nov 05 03:47:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f1ed7ac6-db97-4ab7-993f-858344850377 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "cinder-quobyte-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f1ed7ac6-db97-4ab7-993f-858344850377 tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e" acquired by "delete_volume" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:52 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d04f32-83cf-4446-8ad0-f912ba1cca3b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f1ed7ac6-db97-4ab7-993f-858344850377 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:52 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e Nov 05 03:47:52 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:52 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc 1073741824" returned: 0 in 0.683s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:52 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc Nov 05 03:47:52 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:52 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f1ed7ac6-db97-4ab7-993f-858344850377 tempest-GroupSnapshotsTest-2038618516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e" returned: 0 in 0.428s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f1ed7ac6-db97-4ab7-993f-858344850377 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:52 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:52 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e Nov 05 03:47:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc" returned: 0 in 0.257s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:47:52 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca64caa5-15a7-431b-946f-02d40ca0cc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a523f6a-ffb3-434c-b357-ee40630378fc', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f74bc5e-eaf0-47b4-ae49-153cdb2e09ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:52 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Volume volume-0a523f6a-ffb3-434c-b357-ee40630378fc (0a523f6a-ffb3-434c-b357-ee40630378fc): created successfully Nov 05 03:47:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f74bc5e-eaf0-47b4-ae49-153cdb2e09ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Flow 'volume_create_manager' (d31e8b90-b3b4-4a25-86df-3f71b1b9cf97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:52 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-8e06a604-cb68-4dd6-ada5-86ee46aa597f tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Created volume successfully. Nov 05 03:47:52 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f1ed7ac6-db97-4ab7-993f-858344850377 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e" returned: 0 in 0.322s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f1ed7ac6-db97-4ab7-993f-858344850377 tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-e957f01c-8dd9-4bcb-b7c0-28dde7e3690e" released by "delete_volume" :: held 0.807s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:53 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-f1ed7ac6-db97-4ab7-993f-858344850377 tempest-GroupSnapshotsTest-2038618516 None] Created reservations ['33064557-50d8-4c8d-ab4c-0a6b450fbcdb'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:47:53 devstack cinder-volume[87109]: WARNING cinder.quota [None req-f1ed7ac6-db97-4ab7-993f-858344850377 tempest-GroupSnapshotsTest-2038618516 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1093189227 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1093189227, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:47:53 devstack cinder-volume[87109]: WARNING cinder.quota [None req-f1ed7ac6-db97-4ab7-993f-858344850377 tempest-GroupSnapshotsTest-2038618516 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1093189227 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1093189227, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:47:53 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-f1ed7ac6-db97-4ab7-993f-858344850377 tempest-GroupSnapshotsTest-2038618516 None] Created reservations ['4b4e844c-1153-46bd-9831-cba3349733b1', '70c490e5-9090-4a78-881c-3e931b7d0ee3', 'ea75d92b-d407-4cca-8786-39c63ec9bbf7', '61145c01-38bc-4b31-9684-6584ae33b7ab'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:47:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-de1bf95b-cf67-41eb-9fc2-73dbea67270c tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-de1bf95b-cf67-41eb-9fc2-73dbea67270c tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-de1bf95b-cf67-41eb-9fc2-73dbea67270c tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Creating offline snapshot 4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1 of volume 0a523f6a-ffb3-434c-b357-ee40630378fc {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:47:53 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2559c89c-2013-4ba4-ab24-cd7f469a48e2]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-de1bf95b-cf67-41eb-9fc2-73dbea67270c tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f1ed7ac6-db97-4ab7-993f-858344850377 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f1ed7ac6-db97-4ab7-993f-858344850377 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f1ed7ac6-db97-4ab7-993f-858344850377 tempest-GroupSnapshotsTest-2038618516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f1ed7ac6-db97-4ab7-993f-858344850377 tempest-GroupSnapshotsTest-2038618516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f1ed7ac6-db97-4ab7-993f-858344850377 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f1ed7ac6-db97-4ab7-993f-858344850377 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:53 devstack sudo[94707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:47:53 devstack sudo[94707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:53 devstack sudo[94706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc Nov 05 03:47:53 devstack sudo[94706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:53 devstack sudo[94707]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f1ed7ac6-db97-4ab7-993f-858344850377 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.379s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:53 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-f1ed7ac6-db97-4ab7-993f-858344850377 tempest-GroupSnapshotsTest-2038618516 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:47:53 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f1ed7ac6-db97-4ab7-993f-858344850377 tempest-GroupSnapshotsTest-2038618516 None] Delete group completed successfully. Nov 05 03:47:53 devstack sudo[94706]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-de1bf95b-cf67-41eb-9fc2-73dbea67270c tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc" returned: 0 in 0.474s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-de1bf95b-cf67-41eb-9fc2-73dbea67270c tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:53 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1 1G Nov 05 03:47:53 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:54 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-01d56904-2417-407d-9763-29bc74bfbb6c tempest-VolumesTransfersV357Test-1519028864 None] Transfer volume completed successfully. Nov 05 03:47:54 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-de1bf95b-cf67-41eb-9fc2-73dbea67270c tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1 1G" returned: 0 in 0.535s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-de1bf95b-cf67-41eb-9fc2-73dbea67270c tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a523f6a-ffb3-434c-b357-ee40630378fc -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:54 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a523f6a-ffb3-434c-b357-ee40630378fc -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1 Nov 05 03:47:54 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:54 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] group_snapshot 068e6c6c-20e6-4270-80ec-5b9b91127d13: deleting Nov 05 03:47:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] group_snapshot 068e6c6c-20e6-4270-80ec-5b9b91127d13: deleting {{(pid=87109) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4371}} Nov 05 03:47:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "cinder-quobyte-c5e0a233-e7ea-4662-91a0-efbdf3d223b8" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-c5e0a233-e7ea-4662-91a0-efbdf3d223b8" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "cinder-quobyte-e8d2e574-aded-4516-b4b0-74e9db0eea80" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-e8d2e574-aded-4516-b4b0-74e9db0eea80" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] Deleting offline snapshot e8d2e574-aded-4516-b4b0-74e9db0eea80 of volume c5e0a233-e7ea-4662-91a0-efbdf3d223b8 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:47:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] snapshot_file for this snap is: volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:47:54 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-de1bf95b-cf67-41eb-9fc2-73dbea67270c tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a523f6a-ffb3-434c-b357-ee40630378fc -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1" returned: 0 in 0.452s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:54 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-de1bf95b-cf67-41eb-9fc2-73dbea67270c tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1 is being set with open permissions: ugo+rw Nov 05 03:47:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-de1bf95b-cf67-41eb-9fc2-73dbea67270c tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:54 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04489d7-16f5-4430-a084-a9f9fcd4626c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:54 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1 Nov 05 03:47:54 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-04c7a125-854f-4d03-a6e2-7a2dfecaefe8 tempest-VolumesTransfersV357Test-212416878 None] Acquiring lock "cinder-682e0735-eb4d-40ae-96cf-1aa33e8505a6-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-04c7a125-854f-4d03-a6e2-7a2dfecaefe8 tempest-VolumesTransfersV357Test-212416878 None] Lock "cinder-682e0735-eb4d-40ae-96cf-1aa33e8505a6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:55 devstack sudo[94726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80 Nov 05 03:47:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-04c7a125-854f-4d03-a6e2-7a2dfecaefe8 tempest-VolumesTransfersV357Test-212416878 None] Acquiring lock "cinder-quobyte-682e0735-eb4d-40ae-96cf-1aa33e8505a6" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:55 devstack sudo[94726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-04c7a125-854f-4d03-a6e2-7a2dfecaefe8 tempest-VolumesTransfersV357Test-212416878 None] Lock "cinder-quobyte-682e0735-eb4d-40ae-96cf-1aa33e8505a6" acquired by "delete_volume" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:55 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d86bba-3a1a-4e33-89e7-65feb7ca7728]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-04c7a125-854f-4d03-a6e2-7a2dfecaefe8 tempest-VolumesTransfersV357Test-212416878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-682e0735-eb4d-40ae-96cf-1aa33e8505a6 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:55 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-682e0735-eb4d-40ae-96cf-1aa33e8505a6 Nov 05 03:47:55 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:55 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-de1bf95b-cf67-41eb-9fc2-73dbea67270c tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1" returned: 0 in 0.470s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-de1bf95b-cf67-41eb-9fc2-73dbea67270c tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:55 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.info Nov 05 03:47:55 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:55 devstack sudo[94726]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80" returned: 0 in 0.535s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:47:55 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[94edc059-fa8f-41b3-b4fb-98787c6a7f4a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:55 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-04c7a125-854f-4d03-a6e2-7a2dfecaefe8 tempest-VolumesTransfersV357Test-212416878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-682e0735-eb4d-40ae-96cf-1aa33e8505a6" returned: 0 in 0.453s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-04c7a125-854f-4d03-a6e2-7a2dfecaefe8 tempest-VolumesTransfersV357Test-212416878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-682e0735-eb4d-40ae-96cf-1aa33e8505a6 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:55 devstack sudo[94738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 Nov 05 03:47:55 devstack sudo[94738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:55 devstack sudo[94742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-682e0735-eb4d-40ae-96cf-1aa33e8505a6 Nov 05 03:47:55 devstack sudo[94742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:55 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-de1bf95b-cf67-41eb-9fc2-73dbea67270c tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.info" returned: 0 in 0.318s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:55 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-de1bf95b-cf67-41eb-9fc2-73dbea67270c tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.info is being set with open permissions: ugo+rw Nov 05 03:47:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-de1bf95b-cf67-41eb-9fc2-73dbea67270c tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:55 devstack sudo[94746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.info Nov 05 03:47:55 devstack sudo[94746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:55 devstack sudo[94742]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-04c7a125-854f-4d03-a6e2-7a2dfecaefe8 tempest-VolumesTransfersV357Test-212416878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-682e0735-eb4d-40ae-96cf-1aa33e8505a6" returned: 0 in 0.302s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-04c7a125-854f-4d03-a6e2-7a2dfecaefe8 tempest-VolumesTransfersV357Test-212416878 None] Lock "cinder-quobyte-682e0735-eb4d-40ae-96cf-1aa33e8505a6" released by "delete_volume" :: held 0.812s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:55 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-04c7a125-854f-4d03-a6e2-7a2dfecaefe8 tempest-VolumesTransfersV357Test-212416878 None] Created reservations ['3adb8bca-d524-468f-bbfa-bd8492aa70f7', '0bf942c8-ec83-4045-be07-0be079f42534', '27b30bd0-daad-4825-8da6-883119a873d5', '1ce66e8d-3dd6-4a35-8618-d5e5503bdf37'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:47:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-04c7a125-854f-4d03-a6e2-7a2dfecaefe8 tempest-VolumesTransfersV357Test-212416878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-04c7a125-854f-4d03-a6e2-7a2dfecaefe8 tempest-VolumesTransfersV357Test-212416878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-04c7a125-854f-4d03-a6e2-7a2dfecaefe8 tempest-VolumesTransfersV357Test-212416878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-04c7a125-854f-4d03-a6e2-7a2dfecaefe8 tempest-VolumesTransfersV357Test-212416878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-04c7a125-854f-4d03-a6e2-7a2dfecaefe8 tempest-VolumesTransfersV357Test-212416878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-04c7a125-854f-4d03-a6e2-7a2dfecaefe8 tempest-VolumesTransfersV357Test-212416878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:56 devstack sudo[94746]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-de1bf95b-cf67-41eb-9fc2-73dbea67270c tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.info" returned: 0 in 0.390s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:56 devstack sudo[94753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:47:56 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:56 devstack sudo[94738]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-de1bf95b-cf67-41eb-9fc2-73dbea67270c tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.803s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8" returned: 0 in 0.661s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:56 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80 Nov 05 03:47:56 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:56 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-de1bf95b-cf67-41eb-9fc2-73dbea67270c tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Create snapshot completed successfully Nov 05 03:47:56 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-04c7a125-854f-4d03-a6e2-7a2dfecaefe8 tempest-VolumesTransfersV357Test-212416878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.309s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:56 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-04c7a125-854f-4d03-a6e2-7a2dfecaefe8 tempest-VolumesTransfersV357Test-212416878 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:47:56 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-04c7a125-854f-4d03-a6e2-7a2dfecaefe8 tempest-VolumesTransfersV357Test-212416878 None] Deleted volume successfully. Nov 05 03:47:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-04c7a125-854f-4d03-a6e2-7a2dfecaefe8 tempest-VolumesTransfersV357Test-212416878 None] Lock "cinder-682e0735-eb4d-40ae-96cf-1aa33e8505a6-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:56 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80" returned: 0 in 0.477s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:56 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80 Nov 05 03:47:56 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:56 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8.e8d2e574-aded-4516-b4b0-74e9db0eea80" returned: 0 in 0.331s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-e8d2e574-aded-4516-b4b0-74e9db0eea80" released by "_delete_snapshot" :: held 2.190s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-c5e0a233-e7ea-4662-91a0-efbdf3d223b8" released by "delete_snapshot" :: held 2.225s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:56 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Flow 'volume_create_manager' (d42600a7-73d2-41e7-8453-3628f5ae19a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1cd1791-d219-4b7f-ba91-467d1c5ad504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1cd1791-d219-4b7f-ba91-467d1c5ad504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1199068961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a80623f3-8ba0-4a14-89a7-a4fa96b93e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782ea371ccd042ae9ba19887e499e42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:57Z,use_quota=True,user_id='8b69bb24ee5b4488b2c8946e12162601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0633d26f-2540-4229-8012-8f816d8d4be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0633d26f-2540-4229-8012-8f816d8d4be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ee17ae-b378-40cb-b160-22e9b7633b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ee17ae-b378-40cb-b160-22e9b7633b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a80623f3-8ba0-4a14-89a7-a4fa96b93e0d', 'volume_name': 'volume-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9466a988-d601-4a55-9e48-576ec2128188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9466a988-d601-4a55-9e48-576ec2128188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a840b163-90f2-4dbc-b2cc-7618d5d9d9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:57 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Volume a80623f3-8ba0-4a14-89a7-a4fa96b93e0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d', 'volume_size': 1} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1199068961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a80623f3-8ba0-4a14-89a7-a4fa96b93e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782ea371ccd042ae9ba19887e499e42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:47:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:47:57Z,use_quota=True,user_id='8b69bb24ee5b4488b2c8946e12162601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Creating volume a80623f3-8ba0-4a14-89a7-a4fa96b93e0d {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:47:57 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Acquiring lock "cinder-4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:57 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d 1073741824 Nov 05 03:47:57 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Lock "cinder-4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Acquiring lock "cinder-quobyte-0a523f6a-ffb3-434c-b357-ee40630378fc" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Lock "cinder-quobyte-0a523f6a-ffb3-434c-b357-ee40630378fc" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Acquiring lock "cinder-quobyte-4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:57 devstack cinder-volume[87109]: WARNING cinder.quota [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1093189227 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1093189227, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Lock "cinder-quobyte-4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Deleting offline snapshot 4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1 of volume 0a523f6a-ffb3-434c-b357-ee40630378fc {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] snapshot_file for this snap is: volume-0a523f6a-ffb3-434c-b357-ee40630378fc.4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19bb1fe-2f5c-40e8-bab5-494776fee30b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] Created reservations ['cc9d3312-2556-4547-aed0-62c13c18d33c', 'f81b1f54-ab13-408d-9cee-63bee994a7e8', '4c824ce3-a6b5-4b3a-9a1b-6cc6560a5f15', '6c56e8e9-aa20-4f45-b6c8-2ca83e3794a5'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:47:57 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-163011c5-7127-4f7f-844c-c875d08095c1 tempest-GroupSnapshotsTest-2038618516 None] group_snapshot 068e6c6c-20e6-4270-80ec-5b9b91127d13: deleted successfully Nov 05 03:47:57 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1 Nov 05 03:47:57 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:57 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d 1073741824" returned: 0 in 0.511s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:57 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d Nov 05 03:47:57 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:57 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1" returned: 0 in 0.482s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a523f6a-ffb3-434c-b357-ee40630378fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0cf156-1c94-4c17-8611-3734050c4e26]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:57 devstack sudo[94778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc Nov 05 03:47:57 devstack sudo[94778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:57 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d" returned: 0 in 0.311s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a840b163-90f2-4dbc-b2cc-7618d5d9d9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a3fead-6a7a-4f3a-8daa-2a26870dc43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:47:58 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Volume volume-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d (a80623f3-8ba0-4a14-89a7-a4fa96b93e0d): created successfully Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a3fead-6a7a-4f3a-8daa-2a26870dc43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Flow 'volume_create_manager' (d42600a7-73d2-41e7-8453-3628f5ae19a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:47:58 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-68880e40-66c8-4115-8776-5b4330109141 tempest-VolumesTransfersV357Test-2058767237 None] Created volume successfully. Nov 05 03:47:58 devstack sudo[94778]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc" returned: 0 in 0.433s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:58 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1 Nov 05 03:47:58 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c06d2829-4b0a-4626-b403-315a9cc0e71a tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "cinder-quobyte-c5e0a233-e7ea-4662-91a0-efbdf3d223b8" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c06d2829-4b0a-4626-b403-315a9cc0e71a tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-c5e0a233-e7ea-4662-91a0-efbdf3d223b8" acquired by "delete_volume" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[4190b940-8ff5-4ab3-aafd-122d33ec1806]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c06d2829-4b0a-4626-b403-315a9cc0e71a tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:58 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:47:58 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:58 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 Nov 05 03:47:58 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:58 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1" returned: 0 in 0.521s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:58 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1 Nov 05 03:47:58 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:58 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.291s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 28 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:47:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:47:58 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c06d2829-4b0a-4626-b403-315a9cc0e71a tempest-GroupSnapshotsTest-2038618516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8" returned: 0 in 0.510s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c06d2829-4b0a-4626-b403-315a9cc0e71a tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:59 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8 Nov 05 03:47:59 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:59 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc.4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1" returned: 0 in 0.348s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Lock "cinder-quobyte-4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1" released by "_delete_snapshot" :: held 1.933s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Lock "cinder-quobyte-0a523f6a-ffb3-434c-b357-ee40630378fc" released by "delete_snapshot" :: held 1.965s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Created reservations ['45b8ef71-1602-4767-b3fb-e8fdccaa850d', '44497fab-2c36-4193-9d49-3ac7fb1eba07', 'cc595f94-e60f-4d58-b414-b3cd86fb0200', '8a4b3b6a-3ad3-445f-b282-bdaaaab9241c'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:47:59 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Delete snapshot completed successfully. Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c62b905f-6ae7-4ace-a15d-999ce9f6be58 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Lock "cinder-4bd2c458-4a80-4c8f-ac69-f6b5a842c2a1-delete_snapshot" released by "delete_snapshot" :: held 2.161s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:59 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c06d2829-4b0a-4626-b403-315a9cc0e71a tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c5e0a233-e7ea-4662-91a0-efbdf3d223b8" returned: 0 in 0.331s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c06d2829-4b0a-4626-b403-315a9cc0e71a tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-c5e0a233-e7ea-4662-91a0-efbdf3d223b8" released by "delete_volume" :: held 0.945s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7bbad6e9-3179-4ee4-be03-14416a607467 tempest-VolumesTransfersV357Test-212416878 None] Acquiring lock "cinder-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7bbad6e9-3179-4ee4-be03-14416a607467 tempest-VolumesTransfersV357Test-212416878 None] Lock "cinder-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-c06d2829-4b0a-4626-b403-315a9cc0e71a tempest-GroupSnapshotsTest-2038618516 None] Created reservations ['03e434c3-8498-45b9-a914-b4ad712430af'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:47:59 devstack cinder-volume[87109]: WARNING cinder.db.api [None req-c06d2829-4b0a-4626-b403-315a9cc0e71a tempest-GroupSnapshotsTest-2038618516 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1093189227'] Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7bbad6e9-3179-4ee4-be03-14416a607467 tempest-VolumesTransfersV357Test-212416878 None] Acquiring lock "cinder-quobyte-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-c06d2829-4b0a-4626-b403-315a9cc0e71a tempest-GroupSnapshotsTest-2038618516 None] Created reservations ['b42d12a4-30b9-4054-a601-71d2889b549b', '15b40578-4eac-408b-8dc4-750aa079adad', 'abf7f879-9974-4a28-bfde-ae69dd413ff2', '8ed14d5c-8e89-4943-ab4e-380bb7b86812'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7bbad6e9-3179-4ee4-be03-14416a607467 tempest-VolumesTransfersV357Test-212416878 None] Lock "cinder-quobyte-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d" acquired by "delete_volume" :: waited 0.026s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d61d76-617f-4018-a646-cd798738bace]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7bbad6e9-3179-4ee4-be03-14416a607467 tempest-VolumesTransfersV357Test-212416878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c06d2829-4b0a-4626-b403-315a9cc0e71a tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c06d2829-4b0a-4626-b403-315a9cc0e71a tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c06d2829-4b0a-4626-b403-315a9cc0e71a tempest-GroupSnapshotsTest-2038618516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c06d2829-4b0a-4626-b403-315a9cc0e71a tempest-GroupSnapshotsTest-2038618516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c06d2829-4b0a-4626-b403-315a9cc0e71a tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c06d2829-4b0a-4626-b403-315a9cc0e71a tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:47:59 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d Nov 05 03:47:59 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:59 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:47:59 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:47:59 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c06d2829-4b0a-4626-b403-315a9cc0e71a tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.246s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-c06d2829-4b0a-4626-b403-315a9cc0e71a tempest-GroupSnapshotsTest-2038618516 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:47:59 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-c06d2829-4b0a-4626-b403-315a9cc0e71a tempest-GroupSnapshotsTest-2038618516 None] Delete group completed successfully. Nov 05 03:47:59 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7bbad6e9-3179-4ee4-be03-14416a607467 tempest-VolumesTransfersV357Test-212416878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d" returned: 0 in 0.422s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:47:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7bbad6e9-3179-4ee4-be03-14416a607467 tempest-VolumesTransfersV357Test-212416878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:00 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d Nov 05 03:48:00 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:00 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7bbad6e9-3179-4ee4-be03-14416a607467 tempest-VolumesTransfersV357Test-212416878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d" returned: 0 in 0.333s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7bbad6e9-3179-4ee4-be03-14416a607467 tempest-VolumesTransfersV357Test-212416878 None] Lock "cinder-quobyte-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d" released by "delete_volume" :: held 0.807s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:00 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-7bbad6e9-3179-4ee4-be03-14416a607467 tempest-VolumesTransfersV357Test-212416878 None] Created reservations ['de83566d-6ce0-44f8-a9f0-79606c9a54ea', '293a77d7-6fb1-4fb9-90e6-e4ff0f898605', '03f4b890-e8c7-4acf-b8a4-10a5c983fcef', 'ba5fbda3-82b0-4c00-bb3d-5103cc97a610'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-692c4576-d1bd-402d-bfd8-45b463f2a647 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Acquiring lock "cinder-0a523f6a-ffb3-434c-b357-ee40630378fc-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-692c4576-d1bd-402d-bfd8-45b463f2a647 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Lock "cinder-0a523f6a-ffb3-434c-b357-ee40630378fc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7bbad6e9-3179-4ee4-be03-14416a607467 tempest-VolumesTransfersV357Test-212416878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7bbad6e9-3179-4ee4-be03-14416a607467 tempest-VolumesTransfersV357Test-212416878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7bbad6e9-3179-4ee4-be03-14416a607467 tempest-VolumesTransfersV357Test-212416878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7bbad6e9-3179-4ee4-be03-14416a607467 tempest-VolumesTransfersV357Test-212416878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7bbad6e9-3179-4ee4-be03-14416a607467 tempest-VolumesTransfersV357Test-212416878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7bbad6e9-3179-4ee4-be03-14416a607467 tempest-VolumesTransfersV357Test-212416878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:00 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:48:00 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-692c4576-d1bd-402d-bfd8-45b463f2a647 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Acquiring lock "cinder-quobyte-0a523f6a-ffb3-434c-b357-ee40630378fc" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-692c4576-d1bd-402d-bfd8-45b463f2a647 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Lock "cinder-quobyte-0a523f6a-ffb3-434c-b357-ee40630378fc" acquired by "delete_volume" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:00 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f88b779-e3f2-401c-a468-394e93cc5b10]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-692c4576-d1bd-402d-bfd8-45b463f2a647 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:00 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7bbad6e9-3179-4ee4-be03-14416a607467 tempest-VolumesTransfersV357Test-212416878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.299s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:00 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-7bbad6e9-3179-4ee4-be03-14416a607467 tempest-VolumesTransfersV357Test-212416878 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:48:00 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-7bbad6e9-3179-4ee4-be03-14416a607467 tempest-VolumesTransfersV357Test-212416878 None] Deleted volume successfully. Nov 05 03:48:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7bbad6e9-3179-4ee4-be03-14416a607467 tempest-VolumesTransfersV357Test-212416878 None] Lock "cinder-a80623f3-8ba0-4a14-89a7-a4fa96b93e0d-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:00 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc Nov 05 03:48:00 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:01 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-15a196b6-11f8-45ea-9c3d-be23d73f7296 tempest-GroupSnapshotsTest-2038618516 None] Group tempest-GroupSnapshotsTest-Group-1857376686: creating Nov 05 03:48:01 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-692c4576-d1bd-402d-bfd8-45b463f2a647 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc" returned: 0 in 0.567s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-692c4576-d1bd-402d-bfd8-45b463f2a647 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:01 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc Nov 05 03:48:01 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-15a196b6-11f8-45ea-9c3d-be23d73f7296 tempest-GroupSnapshotsTest-2038618516 None] Group tempest-GroupSnapshotsTest-Group-1857376686: created successfully Nov 05 03:48:01 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:01 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-15a196b6-11f8-45ea-9c3d-be23d73f7296 tempest-GroupSnapshotsTest-2038618516 None] Create group completed successfully. Nov 05 03:48:01 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-692c4576-d1bd-402d-bfd8-45b463f2a647 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-0a523f6a-ffb3-434c-b357-ee40630378fc" returned: 0 in 0.298s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-692c4576-d1bd-402d-bfd8-45b463f2a647 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Lock "cinder-quobyte-0a523f6a-ffb3-434c-b357-ee40630378fc" released by "delete_volume" :: held 0.986s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:01 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-692c4576-d1bd-402d-bfd8-45b463f2a647 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Created reservations ['12cc07d3-243f-4c37-b540-8f505225cff0', '5f04ec76-45c8-4f30-a415-9e62c23177d5', '4ee1dda5-9687-4799-b5a1-8f355161c037', 'ef304f8e-af63-4781-9c8e-9cc8dc00257e'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-692c4576-d1bd-402d-bfd8-45b463f2a647 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-692c4576-d1bd-402d-bfd8-45b463f2a647 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-692c4576-d1bd-402d-bfd8-45b463f2a647 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-692c4576-d1bd-402d-bfd8-45b463f2a647 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-692c4576-d1bd-402d-bfd8-45b463f2a647 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-692c4576-d1bd-402d-bfd8-45b463f2a647 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:01 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:48:01 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:02 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-692c4576-d1bd-402d-bfd8-45b463f2a647 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.259s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:02 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-692c4576-d1bd-402d-bfd8-45b463f2a647 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:48:02 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-692c4576-d1bd-402d-bfd8-45b463f2a647 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Deleted volume successfully. Nov 05 03:48:02 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-692c4576-d1bd-402d-bfd8-45b463f2a647 tempest-VolumeSnapshotQuotasNegativeTestJSON-192543111 None] Lock "cinder-0a523f6a-ffb3-434c-b357-ee40630378fc-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Flow 'volume_create_manager' (e0e60dfc-f78e-4faa-869e-139788bf1fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10d0ff5-58bb-4c5a-ba76-98432aa04788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b10d0ff5-58bb-4c5a-ba76-98432aa04788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1745420948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d012032d-6b82-4732-bb45-a4c39461cbc9,host='devstack@QuobyteHD#QuobyteHD',id=7bbb3feb-097b-4cd5-b774-2243bfd0c549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e6c5a7667746f0ab624a89056f8f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:03Z,use_quota=True,user_id='2d7901c53bf34805ba08c6d7d5704bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f026ba5-c26c-4dd2-800b-91e57642af3b),volume_type_id=3f026ba5-c26c-4dd2-800b-91e57642af3b)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7bcffa3-d526-405a-8400-8dbad338223f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7bcffa3-d526-405a-8400-8dbad338223f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9481f9f-2da7-4ccf-ba0e-61cd3b86d316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9481f9f-2da7-4ccf-ba0e-61cd3b86d316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bbb3feb-097b-4cd5-b774-2243bfd0c549', 'volume_name': 'volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad999ac-5ba6-4e9d-a465-d6ce9e0b8c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad999ac-5ba6-4e9d-a465-d6ce9e0b8c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b75f6b-8cb9-43a2-bf8b-0f3cea06c1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:03 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Volume 7bbb3feb-097b-4cd5-b774-2243bfd0c549: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549', 'volume_size': 1} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d012032d-6b82-4732-bb45-a4c39461cbc9,created_at=2026-11-05T02:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1745420948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d012032d-6b82-4732-bb45-a4c39461cbc9,host='devstack@QuobyteHD#QuobyteHD',id=7bbb3feb-097b-4cd5-b774-2243bfd0c549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e6c5a7667746f0ab624a89056f8f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:03Z,use_quota=True,user_id='2d7901c53bf34805ba08c6d7d5704bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f026ba5-c26c-4dd2-800b-91e57642af3b),volume_type_id=3f026ba5-c26c-4dd2-800b-91e57642af3b)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Creating volume 7bbb3feb-097b-4cd5-b774-2243bfd0c549 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:48:03 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:03 devstack sudo[94855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549 1073741824 Nov 05 03:48:03 devstack sudo[94855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:03 devstack sudo[94855]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549 1073741824" returned: 0 in 0.549s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:03 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549 Nov 05 03:48:03 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:04 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549" returned: 0 in 0.291s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:48:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:04 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=144,cinder:INSERT=43,cinder:UPDATE=162,cinder:DELETE=9 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:48:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b75f6b-8cb9-43a2-bf8b-0f3cea06c1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18010630-f693-4e2d-906d-8935fed4e2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:04 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=131,cinder:INSERT=33,cinder:UPDATE=159,cinder:DELETE=13 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:48:04 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Volume volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549 (7bbb3feb-097b-4cd5-b774-2243bfd0c549): created successfully Nov 05 03:48:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18010630-f693-4e2d-906d-8935fed4e2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Flow 'volume_create_manager' (e0e60dfc-f78e-4faa-869e-139788bf1fb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:04 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5df29ed2-1f9b-4ebe-a50b-d94620184ae3 tempest-GroupSnapshotsTest-2038618516 None] Created volume successfully. Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Flow 'volume_create_manager' (7181e738-336c-4ee1-9576-f620db2113d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80c695b-2848-4917-b72a-c6d960a01f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80c695b-2848-4917-b72a-c6d960a01f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1426651660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d012032d-6b82-4732-bb45-a4c39461cbc9,host='devstack@QuobyteHD#QuobyteHD',id=7de14cce-a30c-43a4-8cab-f378d4b17874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e6c5a7667746f0ab624a89056f8f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:05Z,use_quota=True,user_id='2d7901c53bf34805ba08c6d7d5704bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f026ba5-c26c-4dd2-800b-91e57642af3b),volume_type_id=3f026ba5-c26c-4dd2-800b-91e57642af3b)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (addae26c-dd06-4212-a95c-c2486dae5edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (addae26c-dd06-4212-a95c-c2486dae5edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4248bd5d-8604-4c79-ad13-93c99dcf7dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4248bd5d-8604-4c79-ad13-93c99dcf7dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7de14cce-a30c-43a4-8cab-f378d4b17874', 'volume_name': 'volume-7de14cce-a30c-43a4-8cab-f378d4b17874', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1851776f-ccb4-4002-8d67-b5b4e2e84c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1851776f-ccb4-4002-8d67-b5b4e2e84c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8255b892-4857-4321-ba4e-5d166672d315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:05 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Volume 7de14cce-a30c-43a4-8cab-f378d4b17874: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7de14cce-a30c-43a4-8cab-f378d4b17874', 'volume_size': 1} Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d012032d-6b82-4732-bb45-a4c39461cbc9,created_at=2026-11-05T02:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1426651660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d012032d-6b82-4732-bb45-a4c39461cbc9,host='devstack@QuobyteHD#QuobyteHD',id=7de14cce-a30c-43a4-8cab-f378d4b17874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e6c5a7667746f0ab624a89056f8f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:05Z,use_quota=True,user_id='2d7901c53bf34805ba08c6d7d5704bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f026ba5-c26c-4dd2-800b-91e57642af3b),volume_type_id=3f026ba5-c26c-4dd2-800b-91e57642af3b)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Creating volume 7de14cce-a30c-43a4-8cab-f378d4b17874 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:48:05 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:05 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874 1073741824 Nov 05 03:48:05 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:05 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874 1073741824" returned: 0 in 0.651s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:06 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874 Nov 05 03:48:06 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:06 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874" returned: 0 in 0.384s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:48:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8255b892-4857-4321-ba4e-5d166672d315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7de14cce-a30c-43a4-8cab-f378d4b17874', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8668a66c-707d-430e-8261-94747550f1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:06 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Volume volume-7de14cce-a30c-43a4-8cab-f378d4b17874 (7de14cce-a30c-43a4-8cab-f378d4b17874): created successfully Nov 05 03:48:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8668a66c-707d-430e-8261-94747550f1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Flow 'volume_create_manager' (7181e738-336c-4ee1-9576-f620db2113d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:06 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-73b6f839-edaf-45d1-91e2-65a9add2d55c tempest-GroupSnapshotsTest-2038618516 None] Created volume successfully. Nov 05 03:48:07 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-56d4d18c-a855-4dc2-91ba-84f2000f39e3 tempest-GroupSnapshotsTest-2038618516 None] Update group completed successfully. Nov 05 03:48:09 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-fd430fd9-8d2e-4cf4-b7e8-cb4a2442146d tempest-GroupSnapshotsTest-2038618516 None] Update group completed successfully. Nov 05 03:48:09 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:48:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Flow 'volume_create_manager' (4323fd82-1d43-4d1d-abe6-61c380a9e5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca8bc108-ef3f-4ef5-b244-734ae9d0e76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca8bc108-ef3f-4ef5-b244-734ae9d0e76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-758166650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfa7097-1073-4e5d-8514-db3c947dd3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c12c31f9dc84137a8b36d511fc850bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:09Z,use_quota=True,user_id='58bd43a19841400da4d93d8a65056f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c99d44-dadb-4895-8fb4-7ec30f29bc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c99d44-dadb-4895-8fb4-7ec30f29bc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73eb8b75-fdb7-472f-8435-7e73ff98d99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:09 devstack cinder-volume[87109]: DEBUG cinder.image.glance [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Creating Keystone auth plugin from conf {{(pid=87109) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 03:48:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73eb8b75-fdb7-472f-8435-7e73ff98d99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2cfa7097-1073-4e5d-8514-db3c947dd3cd', 'volume_name': 'volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd', 'volume_size': 1, 'image_id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9a2a266d3247698576f415a1551384', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63a4db91-6545-4f9f-bed7-91a47b0d617e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63a4db91-6545-4f9f-bed7-91a47b0d617e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c59013b4-7f2a-4af3-b0f5-a111ba6fdcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:09 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Volume 2cfa7097-1073-4e5d-8514-db3c947dd3cd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd', 'volume_size': 1, 'image_id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9a2a266d3247698576f415a1551384', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 03:48:09 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Trying to clone 2cfa7097-1073-4e5d-8514-db3c947dd3cd from image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}]). {{(pid=87109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 03:48:10 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_igjzsohfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 05 03:48:10 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Image download 20.69 MB at 20.69 MB/s Nov 05 03:48:10 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e237870b-93a9-451e-a8cb-37bd7e4f1da6]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_igjzsohfdevstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:10 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_igjzsohfdevstack@QuobyteHD Nov 05 03:48:10 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:10 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-4f5da61e-b795-405d-9231-25fdd7c1e684 tempest-GroupSnapshotsTest-2038618516 None] Update group completed successfully. Nov 05 03:48:10 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_igjzsohfdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:10 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Temporary image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 is fetched for user 58bd43a19841400da4d93d8a65056f05. {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 05 03:48:10 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[289d2dd0-a098-478e-a62a-c863d0b46451]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_igjzsohfdevstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:10 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_igjzsohfdevstack@QuobyteHD Nov 05 03:48:10 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:10 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_igjzsohfdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-758166650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfa7097-1073-4e5d-8514-db3c947dd3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c12c31f9dc84137a8b36d511fc850bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:09Z,use_quota=True,user_id='58bd43a19841400da4d93d8a65056f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:48:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Creating volume 2cfa7097-1073-4e5d-8514-db3c947dd3cd {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:48:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:48:10 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:48:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:10 devstack sudo[94929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd 1073741824 Nov 05 03:48:10 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:11 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd 1073741824" returned: 0 in 0.556s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:11 devstack sudo[94934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd Nov 05 03:48:11 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:11 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-ae06840a-a9eb-4631-9dbf-d09ac6315945 tempest-GroupSnapshotsTest-2038618516 None] Update group completed successfully. Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Flow 'volume_create_manager' (9f18b642-f873-49eb-8fd5-f20bf93a3463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4256466c-b670-4f91-b400-9aa60e8f1bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4256466c-b670-4f91-b400-9aa60e8f1bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1010528184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=811c2078-604d-43ea-a704-6ef87256deac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c62fcba293f4524ba3ecbb3b1006076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:12Z,use_quota=True,user_id='c67b98e3eb99410f81631f6ab964fd7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a1dd06-9541-4d27-bd07-71b123ae080a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a1dd06-9541-4d27-bd07-71b123ae080a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79c46a4-d96c-47c0-8138-e0a9454bbbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f79c46a4-d96c-47c0-8138-e0a9454bbbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '811c2078-604d-43ea-a704-6ef87256deac', 'volume_name': 'volume-811c2078-604d-43ea-a704-6ef87256deac', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43253721-96c1-45c9-9433-ebdc740cf8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:11 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43253721-96c1-45c9-9433-ebdc740cf8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6056460-dce5-4ea7-8c26-9ce9f0cba77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:11 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Volume 811c2078-604d-43ea-a704-6ef87256deac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-811c2078-604d-43ea-a704-6ef87256deac', 'volume_size': 1} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd" returned: 0 in 0.291s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1010528184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=811c2078-604d-43ea-a704-6ef87256deac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c62fcba293f4524ba3ecbb3b1006076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:12Z,use_quota=True,user_id='c67b98e3eb99410f81631f6ab964fd7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Creating volume 811c2078-604d-43ea-a704-6ef87256deac {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:48:11 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-811c2078-604d-43ea-a704-6ef87256deac 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:11 devstack sudo[94937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-811c2078-604d-43ea-a704-6ef87256deac 1073741824 Nov 05 03:48:11 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:11 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Attempting download of b71101b4-5e1f-4b78-90ce-ec8cda8c1237 ((None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}])) to volume 2cfa7097-1073-4e5d-8514-db3c947dd3cd. {{(pid=87109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 05 03:48:12 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ad5323-d48c-4ab4-8c69-05866eff8041]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_ie0doqdp {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:12 devstack sudo[94939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_ie0doqdp Nov 05 03:48:12 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:12 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_ie0doqdp" returned: 0 in 0.364s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_ie0doqdp {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:12 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-811c2078-604d-43ea-a704-6ef87256deac 1073741824" returned: 0 in 0.535s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-811c2078-604d-43ea-a704-6ef87256deac {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:12 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-811c2078-604d-43ea-a704-6ef87256deac Nov 05 03:48:12 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:12 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_ie0doqdp Nov 05 03:48:12 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:12 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_ie0doqdp" returned: 1 in 0.387s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_ie0doqdp' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:48:12 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b00a4c6-12a5-4eaf-ba14-0132c42407c2]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_igjzsohfdevstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:12 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-811c2078-604d-43ea-a704-6ef87256deac" returned: 0 in 0.371s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:48:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6056460-dce5-4ea7-8c26-9ce9f0cba77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-811c2078-604d-43ea-a704-6ef87256deac', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a70366-5871-4498-8d8f-fe7feb46a6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:12 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_igjzsohfdevstack@QuobyteHD Nov 05 03:48:12 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:12 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Volume volume-811c2078-604d-43ea-a704-6ef87256deac (811c2078-604d-43ea-a704-6ef87256deac): created successfully Nov 05 03:48:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05a70366-5871-4498-8d8f-fe7feb46a6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Flow 'volume_create_manager' (9f18b642-f873-49eb-8fd5-f20bf93a3463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:12 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-4414cc6f-f84a-4a07-b199-a5708c427589 tempest-AttachVolumeNegativeTest-671600555 None] Created volume successfully. Nov 05 03:48:13 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] GroupSnapshot 85f34de1-aa9a-47d1-9919-3a07f5f3b119: creating. Nov 05 03:48:13 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_igjzsohfdevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:13 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] b71101b4-5e1f-4b78-90ce-ec8cda8c1237 was qcow2, converting to qcow2 {{(pid=87109) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 05 03:48:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_igjzsohfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:13 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_igjzsohfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd Nov 05 03:48:13 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] Group snapshot 85f34de1-aa9a-47d1-9919-3a07f5f3b119: creating. {{(pid=87109) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4196}} Nov 05 03:48:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:13 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] Creating offline snapshot 1ddec2c3-47a0-47c6-9467-be9875e46a3c of volume 7de14cce-a30c-43a4-8cab-f378d4b17874 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:48:13 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[564c483f-955c-4007-9f94-e34a03c4caa1]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:13 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874 Nov 05 03:48:13 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:13 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874" returned: 0 in 0.439s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.1ddec2c3-47a0-47c6-9467-be9875e46a3c 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:13 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.1ddec2c3-47a0-47c6-9467-be9875e46a3c 1G Nov 05 03:48:13 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:14 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.1ddec2c3-47a0-47c6-9467-be9875e46a3c 1G" returned: 0 in 0.663s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7de14cce-a30c-43a4-8cab-f378d4b17874 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.1ddec2c3-47a0-47c6-9467-be9875e46a3c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:14 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7de14cce-a30c-43a4-8cab-f378d4b17874 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.1ddec2c3-47a0-47c6-9467-be9875e46a3c Nov 05 03:48:14 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:14 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7de14cce-a30c-43a4-8cab-f378d4b17874 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.1ddec2c3-47a0-47c6-9467-be9875e46a3c" returned: 0 in 0.440s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:14 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.1ddec2c3-47a0-47c6-9467-be9875e46a3c is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:48:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.1ddec2c3-47a0-47c6-9467-be9875e46a3c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:14 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.1ddec2c3-47a0-47c6-9467-be9875e46a3c Nov 05 03:48:14 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:15 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.1ddec2c3-47a0-47c6-9467-be9875e46a3c" returned: 0 in 0.370s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:15 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.info Nov 05 03:48:15 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-8e97c095-40f5-49fb-bfa9-10476ed72db4 req-eba2119f-4e83-4953-afd2-821c74247493 tempest-AttachVolumeNegativeTest-671600555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:15 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.info" returned: 0 in 0.299s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:15 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:48:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:15 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.info Nov 05 03:48:15 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:15 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_igjzsohfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd" returned: 0 in 2.404s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:15 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_igjzsohfdevstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:48:15 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Converted 112.00 MB image at 46.56 MB/s Nov 05 03:48:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:15 devstack sudo[95010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd 1G Nov 05 03:48:15 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:15 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.info" returned: 0 in 0.277s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.597s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] Creating offline snapshot dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc of volume 7bbb3feb-097b-4cd5-b774-2243bfd0c549 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:48:15 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef0f8ac-312f-4bed-8f86-b2ec2a40ca0c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:15 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd 1G" returned: 0 in 0.353s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:15 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Downloaded image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 ((None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}])) to volume 2cfa7097-1073-4e5d-8514-db3c947dd3cd successfully. {{(pid=87109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 05 03:48:15 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Temporary image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 for user 58bd43a19841400da4d93d8a65056f05 is deleted. {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 05 03:48:15 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Marking volume 2cfa7097-1073-4e5d-8514-db3c947dd3cd as bootable. {{(pid=87109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 05 03:48:15 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Copying metadata from image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 to 2cfa7097-1073-4e5d-8514-db3c947dd3cd. {{(pid=87109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 03:48:15 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Creating volume glance metadata for volume 2cfa7097-1073-4e5d-8514-db3c947dd3cd backed by image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 03:48:15 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549 Nov 05 03:48:15 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c59013b4-7f2a-4af3-b0f5-a111ba6fdcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd', 'volume_size': 1, 'image_id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9a2a266d3247698576f415a1551384', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c5cbf5-b7f6-4664-bca0-7745feb5eb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:16 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Volume volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd (2cfa7097-1073-4e5d-8514-db3c947dd3cd): created successfully Nov 05 03:48:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12c5cbf5-b7f6-4664-bca0-7745feb5eb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Flow 'volume_create_manager' (4323fd82-1d43-4d1d-abe6-61c380a9e5a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:16 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-67cd1da9-e19a-4e83-b7f9-bba6a7196c72 tempest-VolumesExtendTest-322083456 None] Created volume successfully. Nov 05 03:48:16 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549" returned: 0 in 0.392s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:16 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc 1G Nov 05 03:48:16 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:16 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc 1G" returned: 0 in 0.425s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:16 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc Nov 05 03:48:16 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2519bc55-257c-45af-86ed-50d9f22b3803 tempest-VolumesExtendTest-322083456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:17 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc" returned: 0 in 0.336s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:17 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:48:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:17 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc Nov 05 03:48:17 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:17 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc" returned: 0 in 0.247s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:17 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.info Nov 05 03:48:17 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:17 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.info" returned: 0 in 0.259s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:17 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:48:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:17 devstack sudo[95039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.info Nov 05 03:48:17 devstack sudo[95039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:17 devstack sudo[95039]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.info" returned: 0 in 0.246s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-8e97c095-40f5-49fb-bfa9-10476ed72db4 req-eba2119f-4e83-4953-afd2-821c74247493 tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.558s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-8e97c095-40f5-49fb-bfa9-10476ed72db4 req-eba2119f-4e83-4953-afd2-821c74247493 tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2519bc55-257c-45af-86ed-50d9f22b3803 tempest-VolumesExtendTest-322083456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.889s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:17 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[622ebbf6-6c95-4cdb-a45b-60d57b6e4d9a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2519bc55-257c-45af-86ed-50d9f22b3803 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-8e97c095-40f5-49fb-bfa9-10476ed72db4 req-eba2119f-4e83-4953-afd2-821c74247493 tempest-AttachVolumeNegativeTest-671600555 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-811c2078-604d-43ea-a704-6ef87256deac', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18e06462-d07c-4859-9f52-463ab8f82103', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:48:18 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd Nov 05 03:48:18 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:18 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-8e97c095-40f5-49fb-bfa9-10476ed72db4 req-eba2119f-4e83-4953-afd2-821c74247493 tempest-AttachVolumeNegativeTest-671600555 None] attachment_update completed successfully. Nov 05 03:48:18 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-90cb21fe-6373-4169-97b2-8f9053f4b858 tempest-GroupSnapshotsTest-2038618516 None] group_snapshot 85f34de1-aa9a-47d1-9919-3a07f5f3b119: created successfully Nov 05 03:48:18 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2519bc55-257c-45af-86ed-50d9f22b3803 tempest-VolumesExtendTest-322083456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd" returned: 0 in 0.540s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2519bc55-257c-45af-86ed-50d9f22b3803 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd 2G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2519bc55-257c-45af-86ed-50d9f22b3803 tempest-VolumesExtendTest-322083456 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd 2G" returned: 0 in 0.143s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2519bc55-257c-45af-86ed-50d9f22b3803 tempest-VolumesExtendTest-322083456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.728s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:18 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-2519bc55-257c-45af-86ed-50d9f22b3803 tempest-VolumesExtendTest-322083456 None] Extend volume completed successfully. Nov 05 03:48:18 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] group_snapshot 85f34de1-aa9a-47d1-9919-3a07f5f3b119: deleting Nov 05 03:48:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] group_snapshot 85f34de1-aa9a-47d1-9919-3a07f5f3b119: deleting {{(pid=87109) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4371}} Nov 05 03:48:18 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "cinder-quobyte-7de14cce-a30c-43a4-8cab-f378d4b17874" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:18 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-7de14cce-a30c-43a4-8cab-f378d4b17874" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:18 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "cinder-quobyte-1ddec2c3-47a0-47c6-9467-be9875e46a3c" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:18 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-1ddec2c3-47a0-47c6-9467-be9875e46a3c" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Deleting offline snapshot 1ddec2c3-47a0-47c6-9467-be9875e46a3c of volume 7de14cce-a30c-43a4-8cab-f378d4b17874 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:48:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] snapshot_file for this snap is: volume-7de14cce-a30c-43a4-8cab-f378d4b17874.1ddec2c3-47a0-47c6-9467-be9875e46a3c {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:48:18 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e00cf6-8701-4634-941c-a777b5380c8c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.1ddec2c3-47a0-47c6-9467-be9875e46a3c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:19 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.1ddec2c3-47a0-47c6-9467-be9875e46a3c Nov 05 03:48:19 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:19 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.1ddec2c3-47a0-47c6-9467-be9875e46a3c" returned: 0 in 0.498s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7de14cce-a30c-43a4-8cab-f378d4b17874(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:48:19 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f19088-079a-4299-968c-0cf6c9d1c3a0]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:19 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874 Nov 05 03:48:19 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:19 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-24e75513-ac37-4fe3-b314-921786db9f06 tempest-VolumesExtendTest-322083456 None] Acquiring lock "cinder-2cfa7097-1073-4e5d-8514-db3c947dd3cd-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:19 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-24e75513-ac37-4fe3-b314-921786db9f06 tempest-VolumesExtendTest-322083456 None] Lock "cinder-2cfa7097-1073-4e5d-8514-db3c947dd3cd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-24e75513-ac37-4fe3-b314-921786db9f06 tempest-VolumesExtendTest-322083456 None] Acquiring lock "cinder-quobyte-2cfa7097-1073-4e5d-8514-db3c947dd3cd" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-24e75513-ac37-4fe3-b314-921786db9f06 tempest-VolumesExtendTest-322083456 None] Lock "cinder-quobyte-2cfa7097-1073-4e5d-8514-db3c947dd3cd" acquired by "delete_volume" :: waited 0.018s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:20 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[12079f36-7241-4a26-8454-8dc24bde375c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-24e75513-ac37-4fe3-b314-921786db9f06 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:20 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874" returned: 0 in 0.640s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.1ddec2c3-47a0-47c6-9467-be9875e46a3c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:20 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.1ddec2c3-47a0-47c6-9467-be9875e46a3c Nov 05 03:48:20 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:20 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd Nov 05 03:48:20 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:20 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-24e75513-ac37-4fe3-b314-921786db9f06 tempest-VolumesExtendTest-322083456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd" returned: 0 in 0.631s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-24e75513-ac37-4fe3-b314-921786db9f06 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:20 devstack sudo[95495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd Nov 05 03:48:20 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:20 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.1ddec2c3-47a0-47c6-9467-be9875e46a3c" returned: 0 in 0.667s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.1ddec2c3-47a0-47c6-9467-be9875e46a3c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:20 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.1ddec2c3-47a0-47c6-9467-be9875e46a3c Nov 05 03:48:20 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:21 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874.1ddec2c3-47a0-47c6-9467-be9875e46a3c" returned: 0 in 0.392s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:21 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-1ddec2c3-47a0-47c6-9467-be9875e46a3c" released by "_delete_snapshot" :: held 2.420s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-24e75513-ac37-4fe3-b314-921786db9f06 tempest-VolumesExtendTest-322083456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2cfa7097-1073-4e5d-8514-db3c947dd3cd" returned: 0 in 0.538s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-7de14cce-a30c-43a4-8cab-f378d4b17874" released by "delete_snapshot" :: held 2.481s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-24e75513-ac37-4fe3-b314-921786db9f06 tempest-VolumesExtendTest-322083456 None] Lock "cinder-quobyte-2cfa7097-1073-4e5d-8514-db3c947dd3cd" released by "delete_volume" :: held 1.270s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "cinder-quobyte-7bbb3feb-097b-4cd5-b774-2243bfd0c549" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-7bbb3feb-097b-4cd5-b774-2243bfd0c549" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "cinder-quobyte-dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Deleting offline snapshot dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc of volume 7bbb3feb-097b-4cd5-b774-2243bfd0c549 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] snapshot_file for this snap is: volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae0d2f8-69c5-49fe-9e34-fe08b9e6cd24]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-24e75513-ac37-4fe3-b314-921786db9f06 tempest-VolumesExtendTest-322083456 None] Created reservations ['0065e277-6308-4674-8a26-164f297bffe2', 'b863e090-0752-4d57-9b83-87dc1c104495', '4b6a0349-b27c-4df0-9eae-a2accff27b97', 'adb3a70c-eb5e-4d7d-beb1-126ef29f67fc'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:21 devstack sudo[95504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc Nov 05 03:48:21 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-24e75513-ac37-4fe3-b314-921786db9f06 tempest-VolumesExtendTest-322083456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-24e75513-ac37-4fe3-b314-921786db9f06 tempest-VolumesExtendTest-322083456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-24e75513-ac37-4fe3-b314-921786db9f06 tempest-VolumesExtendTest-322083456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-24e75513-ac37-4fe3-b314-921786db9f06 tempest-VolumesExtendTest-322083456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-24e75513-ac37-4fe3-b314-921786db9f06 tempest-VolumesExtendTest-322083456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-24e75513-ac37-4fe3-b314-921786db9f06 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:21 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:48:21 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:21 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc" returned: 0 in 0.449s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ca61b1-2d70-42ae-85b2-ee3c83b38708]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:21 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-24e75513-ac37-4fe3-b314-921786db9f06 tempest-VolumesExtendTest-322083456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.369s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:22 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-24e75513-ac37-4fe3-b314-921786db9f06 tempest-VolumesExtendTest-322083456 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:48:22 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-24e75513-ac37-4fe3-b314-921786db9f06 tempest-VolumesExtendTest-322083456 None] Deleted volume successfully. Nov 05 03:48:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-24e75513-ac37-4fe3-b314-921786db9f06 tempest-VolumesExtendTest-322083456 None] Lock "cinder-2cfa7097-1073-4e5d-8514-db3c947dd3cd-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:22 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549 Nov 05 03:48:22 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:22 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549" returned: 0 in 0.608s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:22 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc Nov 05 03:48:22 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Flow 'volume_create_manager' (d3cc4f28-a1a2-4b9a-a948-a7e6c68ebcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4067c890-4faa-44c5-abf2-9d8db3bf46d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4067c890-4faa-44c5-abf2-9d8db3bf46d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-628478594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dec5a7aa-66e8-4dfb-bd3c-07241cbbd428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c12c31f9dc84137a8b36d511fc850bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:23Z,use_quota=True,user_id='58bd43a19841400da4d93d8a65056f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b4dc02-eb57-4883-a151-0b411d3fe0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b4dc02-eb57-4883-a151-0b411d3fe0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1dc634-60c9-4202-b628-32b27a90c3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1dc634-60c9-4202-b628-32b27a90c3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dec5a7aa-66e8-4dfb-bd3c-07241cbbd428', 'volume_name': 'volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7f0e51-5fe5-4644-9cca-43bd116ea549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7f0e51-5fe5-4644-9cca-43bd116ea549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b48d4662-90a1-44c4-b4f1-c3f96fcd67de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:23 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Volume dec5a7aa-66e8-4dfb-bd3c-07241cbbd428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428', 'volume_size': 1} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-628478594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dec5a7aa-66e8-4dfb-bd3c-07241cbbd428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c12c31f9dc84137a8b36d511fc850bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:23Z,use_quota=True,user_id='58bd43a19841400da4d93d8a65056f05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Creating volume dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:48:23 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:23 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 1073741824 Nov 05 03:48:23 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:23 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc" returned: 0 in 0.690s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:23 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc Nov 05 03:48:23 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:23 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549.dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc" returned: 0 in 0.315s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-dfbfb1cb-b2a1-44bd-884e-8d8e3b7404cc" released by "_delete_snapshot" :: held 2.255s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-7bbb3feb-097b-4cd5-b774-2243bfd0c549" released by "delete_snapshot" :: held 2.306s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:23 devstack cinder-volume[87109]: WARNING cinder.quota [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-382079547 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-382079547, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:48:23 devstack cinder-volume[87109]: WARNING cinder.quota [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-382079547 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-382079547, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Created reservations ['3d563111-1a4f-4adc-b739-131009aa3e32', '0b62fb3c-6a38-444f-a1e5-cf872cb3afcd', '4e014760-ee3b-4501-914d-55ad86c8afe8', '6f6fdf82-ead9-4ce0-93d4-e648e2dbe67b'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:23 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 1073741824" returned: 0 in 0.680s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] Created reservations ['c38e2643-93b3-421a-a008-8f17aaba8f1e', '2ee9879d-62b9-489f-a065-47ff25f964e8', '96602bc8-5366-4ca8-8a8b-3b4e2595912e', '8f66d635-b29f-469b-b102-2ac113c6c942'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:24 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 Nov 05 03:48:24 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:24 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-21f20230-fdac-46e5-988c-887ac61cfc81 tempest-GroupSnapshotsTest-2038618516 None] group_snapshot 85f34de1-aa9a-47d1-9919-3a07f5f3b119: deleted successfully Nov 05 03:48:24 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428" returned: 0 in 0.314s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:24 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:48:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:24 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b48d4662-90a1-44c4-b4f1-c3f96fcd67de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:24 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (382381c2-9529-431a-9841-f8b1776ebd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:24 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Volume volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 (dec5a7aa-66e8-4dfb-bd3c-07241cbbd428): created successfully Nov 05 03:48:24 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (382381c2-9529-431a-9841-f8b1776ebd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:24 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Flow 'volume_create_manager' (d3cc4f28-a1a2-4b9a-a948-a7e6c68ebcb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:24 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-2b7e08b9-0805-41da-9d71-52c7585ff69d tempest-VolumesExtendTest-322083456 None] Created volume successfully. Nov 05 03:48:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "cinder-quobyte-7bbb3feb-097b-4cd5-b774-2243bfd0c549" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-7bbb3feb-097b-4cd5-b774-2243bfd0c549" acquired by "delete_volume" :: waited 0.018s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:25 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1aedaf-c78e-4543-8cb2-f48710fe07d5]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:25 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549 Nov 05 03:48:25 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4dd5cc51-07e5-404f-9c1b-8f4b0a9bf602 tempest-VolumesExtendTest-322083456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4dd5cc51-07e5-404f-9c1b-8f4b0a9bf602 tempest-VolumesExtendTest-322083456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-4dd5cc51-07e5-404f-9c1b-8f4b0a9bf602 tempest-VolumesExtendTest-322083456 None] Creating offline snapshot c59248f4-72ed-40c8-b166-0eee01acf234 of volume dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:48:25 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0a4431-5342-4cf8-8c98-428dc7de42b4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4dd5cc51-07e5-404f-9c1b-8f4b0a9bf602 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:25 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549" returned: 0 in 0.546s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:25 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549 Nov 05 03:48:25 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:25 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 Nov 05 03:48:25 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:25 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7bbb3feb-097b-4cd5-b774-2243bfd0c549" returned: 0 in 0.333s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-7bbb3feb-097b-4cd5-b774-2243bfd0c549" released by "delete_volume" :: held 1.003s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "cinder-quobyte-7de14cce-a30c-43a4-8cab-f378d4b17874" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-7de14cce-a30c-43a4-8cab-f378d4b17874" acquired by "delete_volume" :: waited 0.020s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:26 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5e3957-2313-444e-abfc-703051f03a94]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:26 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4dd5cc51-07e5-404f-9c1b-8f4b0a9bf602 tempest-VolumesExtendTest-322083456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428" returned: 0 in 0.584s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4dd5cc51-07e5-404f-9c1b-8f4b0a9bf602 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:26 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234 1G Nov 05 03:48:26 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:26 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874 Nov 05 03:48:26 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:26 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874" returned: 0 in 0.540s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:26 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874 Nov 05 03:48:26 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:26 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4dd5cc51-07e5-404f-9c1b-8f4b0a9bf602 tempest-VolumesExtendTest-322083456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234 1G" returned: 0 in 0.685s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4dd5cc51-07e5-404f-9c1b-8f4b0a9bf602 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:26 devstack sudo[95567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234 Nov 05 03:48:26 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:26 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7de14cce-a30c-43a4-8cab-f378d4b17874" returned: 0 in 0.337s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-7de14cce-a30c-43a4-8cab-f378d4b17874" released by "delete_volume" :: held 0.981s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:27 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Created reservations ['d04e2abc-7520-439f-b235-2d3b4c8d9bfc'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:27 devstack cinder-volume[87109]: WARNING cinder.quota [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-382079547 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-382079547, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:48:27 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4dd5cc51-07e5-404f-9c1b-8f4b0a9bf602 tempest-VolumesExtendTest-322083456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234" returned: 0 in 0.457s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:27 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-4dd5cc51-07e5-404f-9c1b-8f4b0a9bf602 tempest-VolumesExtendTest-322083456 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234 is being set with open permissions: ugo+rw Nov 05 03:48:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4dd5cc51-07e5-404f-9c1b-8f4b0a9bf602 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:27 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Created reservations ['9288267e-1974-4c00-8686-61b1ce165e1b', 'f54132b9-7d6d-4d0d-ae0e-8e0652a7f170', '7a27f454-bee3-4992-8843-b14e902e3970', '8a28afa4-cad5-45f0-9d9a-0bfcac3a44a4'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:27 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234 Nov 05 03:48:27 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:27 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Created reservations ['494c5355-7b02-4a0d-84ed-4dbb53940d56', '1989227f-5fcb-4b77-9313-94f8fa47e115', '3b89b266-59db-4d9b-bca3-5258e6c9e952', '8698a482-ca3a-4574-831d-bb7990e72fb0'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:27 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4dd5cc51-07e5-404f-9c1b-8f4b0a9bf602 tempest-VolumesExtendTest-322083456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234" returned: 0 in 0.426s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:27 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:27 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4dd5cc51-07e5-404f-9c1b-8f4b0a9bf602 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:27 devstack sudo[95591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:48:27 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:27 devstack sudo[95593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.info Nov 05 03:48:27 devstack sudo[95593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:28 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.297s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:28 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:48:28 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-3d557191-e3cd-42cc-adc7-e13a2a3035ab tempest-GroupSnapshotsTest-2038618516 None] Delete group completed successfully. Nov 05 03:48:28 devstack sudo[95593]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4dd5cc51-07e5-404f-9c1b-8f4b0a9bf602 tempest-VolumesExtendTest-322083456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.info" returned: 0 in 0.374s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:28 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-4dd5cc51-07e5-404f-9c1b-8f4b0a9bf602 tempest-VolumesExtendTest-322083456 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.info is being set with open permissions: ugo+rw Nov 05 03:48:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4dd5cc51-07e5-404f-9c1b-8f4b0a9bf602 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:28 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.info Nov 05 03:48:28 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:28 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4dd5cc51-07e5-404f-9c1b-8f4b0a9bf602 tempest-VolumesExtendTest-322083456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.info" returned: 0 in 0.298s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4dd5cc51-07e5-404f-9c1b-8f4b0a9bf602 tempest-VolumesExtendTest-322083456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.024s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:28 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-4dd5cc51-07e5-404f-9c1b-8f4b0a9bf602 tempest-VolumesExtendTest-322083456 None] Create snapshot completed successfully Nov 05 03:48:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4dce9970-504a-40ff-9885-92f0dc66d290 tempest-VolumesExtendTest-322083456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4dce9970-504a-40ff-9885-92f0dc66d290 tempest-VolumesExtendTest-322083456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:28 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b76f3a-e086-413d-bd3d-c9e3538ee7f6]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4dce9970-504a-40ff-9885-92f0dc66d290 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:29 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 Nov 05 03:48:29 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:29 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-fd6eb0df-9e7b-4014-bda5-c0b79f2cb29b tempest-GroupSnapshotsTest-2038618516 None] Group tempest-GroupSnapshotsTest-Group-728415981: creating Nov 05 03:48:29 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-fd6eb0df-9e7b-4014-bda5-c0b79f2cb29b tempest-GroupSnapshotsTest-2038618516 None] Group tempest-GroupSnapshotsTest-Group-728415981: created successfully Nov 05 03:48:29 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-fd6eb0df-9e7b-4014-bda5-c0b79f2cb29b tempest-GroupSnapshotsTest-2038618516 None] Create group completed successfully. Nov 05 03:48:29 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4dce9970-504a-40ff-9885-92f0dc66d290 tempest-VolumesExtendTest-322083456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428" returned: 0 in 0.512s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4dce9970-504a-40ff-9885-92f0dc66d290 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234 2G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4dce9970-504a-40ff-9885-92f0dc66d290 tempest-VolumesExtendTest-322083456 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234 2G" returned: 0 in 0.196s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4dce9970-504a-40ff-9885-92f0dc66d290 tempest-VolumesExtendTest-322083456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.775s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:29 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-4dce9970-504a-40ff-9885-92f0dc66d290 tempest-VolumesExtendTest-322083456 None] Extend volume completed successfully. Nov 05 03:48:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] Acquiring lock "cinder-c59248f4-72ed-40c8-b166-0eee01acf234-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] Lock "cinder-c59248f4-72ed-40c8-b166-0eee01acf234-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] Acquiring lock "cinder-quobyte-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] Lock "cinder-quobyte-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] Acquiring lock "cinder-quobyte-c59248f4-72ed-40c8-b166-0eee01acf234" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] Lock "cinder-quobyte-c59248f4-72ed-40c8-b166-0eee01acf234" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] Deleting offline snapshot c59248f4-72ed-40c8-b166-0eee01acf234 of volume dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:48:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] snapshot_file for this snap is: volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:48:30 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9fbbe9-fd90-48cc-a819-19bd603b9738]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:30 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234 Nov 05 03:48:30 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:30 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234" returned: 0 in 0.588s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc67f103-eba6-485b-9df7-01c8a03f6d4e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:31 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 Nov 05 03:48:31 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Flow 'volume_create_manager' (07d95740-b960-4ab8-9c5b-0b58e86a8a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b72df5-5cfe-4041-a061-627362fd531b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b72df5-5cfe-4041-a061-627362fd531b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-560165074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=79819e73-d560-4e84-be19-af7165a5bc9d,host='devstack@QuobyteHD#QuobyteHD',id=b7c6040f-6ba3-40d5-9288-d0eef6d8c52a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e6c5a7667746f0ab624a89056f8f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:31Z,use_quota=True,user_id='2d7901c53bf34805ba08c6d7d5704bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efc33ecc-f55c-4ffd-954f-b5ef3118f2dc),volume_type_id=efc33ecc-f55c-4ffd-954f-b5ef3118f2dc)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b02b3a-dfc8-4307-892a-2cd6e3ae6987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23b02b3a-dfc8-4307-892a-2cd6e3ae6987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ffb52fc-f730-4da3-9810-f2fbfa7bbd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ffb52fc-f730-4da3-9810-f2fbfa7bbd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7c6040f-6ba3-40d5-9288-d0eef6d8c52a', 'volume_name': 'volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4a0a5a-40fa-4f49-9386-fbe2fe364ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4a0a5a-40fa-4f49-9386-fbe2fe364ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0829c4db-9e69-4960-9b86-a0bc1c24ec46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:31 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Volume b7c6040f-6ba3-40d5-9288-d0eef6d8c52a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a', 'volume_size': 1} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=79819e73-d560-4e84-be19-af7165a5bc9d,created_at=2026-11-05T02:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-560165074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=79819e73-d560-4e84-be19-af7165a5bc9d,host='devstack@QuobyteHD#QuobyteHD',id=b7c6040f-6ba3-40d5-9288-d0eef6d8c52a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e6c5a7667746f0ab624a89056f8f0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:31Z,use_quota=True,user_id='2d7901c53bf34805ba08c6d7d5704bfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(efc33ecc-f55c-4ffd-954f-b5ef3118f2dc),volume_type_id=efc33ecc-f55c-4ffd-954f-b5ef3118f2dc)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Creating volume b7c6040f-6ba3-40d5-9288-d0eef6d8c52a {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:48:31 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:31 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a 1073741824 Nov 05 03:48:31 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Flow 'volume_create_manager' (4462a85b-b975-47b3-a8fe-66f1087e76bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0770e738-e0c6-4041-b220-70a2a60180fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0770e738-e0c6-4041-b220-70a2a60180fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-263196785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0807872-55a1-4e15-a02f-412f574c7f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21aad20dee84404a51c6dcd39ff0f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:32Z,use_quota=True,user_id='0141afcd177e48b3b5dbe0a95dc7ea49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a299e15-8da1-4ce2-b505-1c45415428fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a299e15-8da1-4ce2-b505-1c45415428fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b508db69-b09f-4e74-9c21-b400d86430f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b508db69-b09f-4e74-9c21-b400d86430f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0807872-55a1-4e15-a02f-412f574c7f89', 'volume_name': 'volume-e0807872-55a1-4e15-a02f-412f574c7f89', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8feb0920-0d3e-4de0-8688-a1a9e07bd80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8feb0920-0d3e-4de0-8688-a1a9e07bd80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54380d07-96d2-4419-b8cd-dbdea466d376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:31 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Volume e0807872-55a1-4e15-a02f-412f574c7f89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0807872-55a1-4e15-a02f-412f574c7f89', 'volume_size': 1} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:31 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428" returned: 0 in 0.897s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:31 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234 Nov 05 03:48:31 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:32 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a 1073741824" returned: 0 in 0.719s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:32 devstack sudo[95676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a Nov 05 03:48:32 devstack sudo[95676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:32 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234" returned: 0 in 0.491s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:32 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234 Nov 05 03:48:32 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:32 devstack sudo[95676]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a" returned: 0 in 0.506s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:48:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.990s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-263196785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0807872-55a1-4e15-a02f-412f574c7f89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21aad20dee84404a51c6dcd39ff0f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:32Z,use_quota=True,user_id='0141afcd177e48b3b5dbe0a95dc7ea49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:48:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Creating volume e0807872-55a1-4e15-a02f-412f574c7f89 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:48:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:48:32 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:48:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0807872-55a1-4e15-a02f-412f574c7f89 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:32 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428.c59248f4-72ed-40c8-b166-0eee01acf234" returned: 0 in 0.498s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:32 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0807872-55a1-4e15-a02f-412f574c7f89 1073741824 Nov 05 03:48:32 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0829c4db-9e69-4960-9b86-a0bc1c24ec46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288993fd-7dd5-4788-a939-1f000c8cb1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:32 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Volume volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a (b7c6040f-6ba3-40d5-9288-d0eef6d8c52a): created successfully Nov 05 03:48:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288993fd-7dd5-4788-a939-1f000c8cb1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Flow 'volume_create_manager' (07d95740-b960-4ab8-9c5b-0b58e86a8a09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] Lock "cinder-quobyte-c59248f4-72ed-40c8-b166-0eee01acf234" released by "_delete_snapshot" :: held 2.745s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] Lock "cinder-quobyte-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428" released by "delete_snapshot" :: held 2.774s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:33 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-2c3fcba6-20be-4a83-84f0-d58328c8f707 tempest-GroupSnapshotsTest-2038618516 None] Created volume successfully. Nov 05 03:48:33 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] Created reservations ['9d7a66f6-1757-4055-ba33-9308e779ad7d', '87885097-9aee-4e2e-85e7-92a76f0b8536', 'c7aabb3a-8948-480f-81db-f3666922c632', 'a57e579f-acb0-46dc-ae21-e559790a2fb1'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:33 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] Delete snapshot completed successfully. Nov 05 03:48:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-147f1f85-1894-4683-a904-baa7ec3aafc7 tempest-VolumesExtendTest-322083456 None] Lock "cinder-c59248f4-72ed-40c8-b166-0eee01acf234-delete_snapshot" released by "delete_snapshot" :: held 2.943s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:33 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0807872-55a1-4e15-a02f-412f574c7f89 1073741824" returned: 0 in 0.494s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0807872-55a1-4e15-a02f-412f574c7f89 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:33 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0807872-55a1-4e15-a02f-412f574c7f89 Nov 05 03:48:33 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-64ca3d2e-2ac8-4a81-bf45-7c83211477d4 tempest-VolumesExtendTest-322083456 None] Acquiring lock "cinder-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-64ca3d2e-2ac8-4a81-bf45-7c83211477d4 tempest-VolumesExtendTest-322083456 None] Lock "cinder-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-64ca3d2e-2ac8-4a81-bf45-7c83211477d4 tempest-VolumesExtendTest-322083456 None] Acquiring lock "cinder-quobyte-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-64ca3d2e-2ac8-4a81-bf45-7c83211477d4 tempest-VolumesExtendTest-322083456 None] Lock "cinder-quobyte-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428" acquired by "delete_volume" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:33 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[55284ad7-cd7b-4135-8dd9-8f7f1724ea59]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-64ca3d2e-2ac8-4a81-bf45-7c83211477d4 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:33 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0807872-55a1-4e15-a02f-412f574c7f89" returned: 0 in 0.361s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:48:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54380d07-96d2-4419-b8cd-dbdea466d376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0807872-55a1-4e15-a02f-412f574c7f89', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90ebce7-a94f-472e-9de9-b0c13a607c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:33 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Volume volume-e0807872-55a1-4e15-a02f-412f574c7f89 (e0807872-55a1-4e15-a02f-412f574c7f89): created successfully Nov 05 03:48:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c90ebce7-a94f-472e-9de9-b0c13a607c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Flow 'volume_create_manager' (4462a85b-b975-47b3-a8fe-66f1087e76bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:33 devstack sudo[95692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 Nov 05 03:48:33 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:33 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-90456a1c-58a1-419a-b0e9-2f8fd10e4be7 tempest-VolumesMetadataTest-203126427 None] Created volume successfully. Nov 05 03:48:34 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-64ca3d2e-2ac8-4a81-bf45-7c83211477d4 tempest-VolumesExtendTest-322083456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428" returned: 0 in 0.569s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-64ca3d2e-2ac8-4a81-bf45-7c83211477d4 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:34 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-77061503-18ad-488c-8445-5626cce63594 tempest-GroupSnapshotsTest-2038618516 None] GroupSnapshot 8c593a33-f3da-4c76-b276-8d811d09d9d5: creating. Nov 05 03:48:34 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428 Nov 05 03:48:34 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-77061503-18ad-488c-8445-5626cce63594 tempest-GroupSnapshotsTest-2038618516 None] Group snapshot 8c593a33-f3da-4c76-b276-8d811d09d9d5: creating. {{(pid=87109) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4196}} Nov 05 03:48:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-77061503-18ad-488c-8445-5626cce63594 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-77061503-18ad-488c-8445-5626cce63594 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-77061503-18ad-488c-8445-5626cce63594 tempest-GroupSnapshotsTest-2038618516 None] Creating offline snapshot 90a17f56-9a1b-455e-9b99-eacf989cbdc8 of volume b7c6040f-6ba3-40d5-9288-d0eef6d8c52a {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:48:34 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54207c9-5f1c-49f3-bcbd-b14e5d5184c2]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-77061503-18ad-488c-8445-5626cce63594 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:34 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a Nov 05 03:48:34 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:34 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-64ca3d2e-2ac8-4a81-bf45-7c83211477d4 tempest-VolumesExtendTest-322083456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428" returned: 0 in 0.321s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-64ca3d2e-2ac8-4a81-bf45-7c83211477d4 tempest-VolumesExtendTest-322083456 None] Lock "cinder-quobyte-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428" released by "delete_volume" :: held 1.004s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:34 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-64ca3d2e-2ac8-4a81-bf45-7c83211477d4 tempest-VolumesExtendTest-322083456 None] Created reservations ['d89631bd-154d-4afb-98c2-0be953afae91', 'e5a34844-dda0-48d3-a739-478cfbe193e7', '560b4335-09ea-4339-9f0d-26eb95605603', 'e5cb02e6-93c2-40e2-8430-9161a4332569'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-64ca3d2e-2ac8-4a81-bf45-7c83211477d4 tempest-VolumesExtendTest-322083456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-64ca3d2e-2ac8-4a81-bf45-7c83211477d4 tempest-VolumesExtendTest-322083456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-64ca3d2e-2ac8-4a81-bf45-7c83211477d4 tempest-VolumesExtendTest-322083456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-64ca3d2e-2ac8-4a81-bf45-7c83211477d4 tempest-VolumesExtendTest-322083456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-64ca3d2e-2ac8-4a81-bf45-7c83211477d4 tempest-VolumesExtendTest-322083456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-64ca3d2e-2ac8-4a81-bf45-7c83211477d4 tempest-VolumesExtendTest-322083456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:34 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:48:34 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:35 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-77061503-18ad-488c-8445-5626cce63594 tempest-GroupSnapshotsTest-2038618516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a" returned: 0 in 0.711s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-77061503-18ad-488c-8445-5626cce63594 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.90a17f56-9a1b-455e-9b99-eacf989cbdc8 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:35 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.90a17f56-9a1b-455e-9b99-eacf989cbdc8 1G Nov 05 03:48:35 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:35 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-64ca3d2e-2ac8-4a81-bf45-7c83211477d4 tempest-VolumesExtendTest-322083456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.456s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:35 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-64ca3d2e-2ac8-4a81-bf45-7c83211477d4 tempest-VolumesExtendTest-322083456 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:48:35 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-64ca3d2e-2ac8-4a81-bf45-7c83211477d4 tempest-VolumesExtendTest-322083456 None] Deleted volume successfully. Nov 05 03:48:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-64ca3d2e-2ac8-4a81-bf45-7c83211477d4 tempest-VolumesExtendTest-322083456 None] Lock "cinder-dec5a7aa-66e8-4dfb-bd3c-07241cbbd428-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:35 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-77061503-18ad-488c-8445-5626cce63594 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.90a17f56-9a1b-455e-9b99-eacf989cbdc8 1G" returned: 0 in 0.674s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-77061503-18ad-488c-8445-5626cce63594 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.90a17f56-9a1b-455e-9b99-eacf989cbdc8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:35 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.90a17f56-9a1b-455e-9b99-eacf989cbdc8 Nov 05 03:48:35 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:36 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-77061503-18ad-488c-8445-5626cce63594 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.90a17f56-9a1b-455e-9b99-eacf989cbdc8" returned: 0 in 0.497s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:36 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-77061503-18ad-488c-8445-5626cce63594 tempest-GroupSnapshotsTest-2038618516 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.90a17f56-9a1b-455e-9b99-eacf989cbdc8 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:48:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-77061503-18ad-488c-8445-5626cce63594 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.90a17f56-9a1b-455e-9b99-eacf989cbdc8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4f70f214-e799-4e4e-9c58-633e62d44c9f tempest-VolumesMetadataTest-203126427 None] Acquiring lock "cinder-e0807872-55a1-4e15-a02f-412f574c7f89-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:36 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.90a17f56-9a1b-455e-9b99-eacf989cbdc8 Nov 05 03:48:36 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4f70f214-e799-4e4e-9c58-633e62d44c9f tempest-VolumesMetadataTest-203126427 None] Lock "cinder-e0807872-55a1-4e15-a02f-412f574c7f89-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4f70f214-e799-4e4e-9c58-633e62d44c9f tempest-VolumesMetadataTest-203126427 None] Acquiring lock "cinder-quobyte-e0807872-55a1-4e15-a02f-412f574c7f89" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4f70f214-e799-4e4e-9c58-633e62d44c9f tempest-VolumesMetadataTest-203126427 None] Lock "cinder-quobyte-e0807872-55a1-4e15-a02f-412f574c7f89" acquired by "delete_volume" :: waited 0.045s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:36 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fed4fd-3309-41d8-b706-7ff5ec37f49a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4f70f214-e799-4e4e-9c58-633e62d44c9f tempest-VolumesMetadataTest-203126427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0807872-55a1-4e15-a02f-412f574c7f89 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:36 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-77061503-18ad-488c-8445-5626cce63594 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.90a17f56-9a1b-455e-9b99-eacf989cbdc8" returned: 0 in 0.353s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-77061503-18ad-488c-8445-5626cce63594 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:36 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0807872-55a1-4e15-a02f-412f574c7f89 Nov 05 03:48:36 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:36 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.info Nov 05 03:48:36 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:37 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-77061503-18ad-488c-8445-5626cce63594 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.info" returned: 0 in 0.404s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:37 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-77061503-18ad-488c-8445-5626cce63594 tempest-GroupSnapshotsTest-2038618516 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 03:48:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-77061503-18ad-488c-8445-5626cce63594 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:37 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4f70f214-e799-4e4e-9c58-633e62d44c9f tempest-VolumesMetadataTest-203126427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0807872-55a1-4e15-a02f-412f574c7f89" returned: 0 in 0.561s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4f70f214-e799-4e4e-9c58-633e62d44c9f tempest-VolumesMetadataTest-203126427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0807872-55a1-4e15-a02f-412f574c7f89 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:37 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.info Nov 05 03:48:37 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:37 devstack sudo[95735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0807872-55a1-4e15-a02f-412f574c7f89 Nov 05 03:48:37 devstack sudo[95735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:37 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-77061503-18ad-488c-8445-5626cce63594 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.info" returned: 0 in 0.370s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-77061503-18ad-488c-8445-5626cce63594 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.160s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:37 devstack sudo[95735]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4f70f214-e799-4e4e-9c58-633e62d44c9f tempest-VolumesMetadataTest-203126427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0807872-55a1-4e15-a02f-412f574c7f89" returned: 0 in 0.443s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4f70f214-e799-4e4e-9c58-633e62d44c9f tempest-VolumesMetadataTest-203126427 None] Lock "cinder-quobyte-e0807872-55a1-4e15-a02f-412f574c7f89" released by "delete_volume" :: held 1.083s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:37 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-77061503-18ad-488c-8445-5626cce63594 tempest-GroupSnapshotsTest-2038618516 None] group_snapshot 8c593a33-f3da-4c76-b276-8d811d09d9d5: created successfully Nov 05 03:48:37 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-4f70f214-e799-4e4e-9c58-633e62d44c9f tempest-VolumesMetadataTest-203126427 None] Created reservations ['639ab89f-aa5a-4c37-838c-baf8e9d7baaf', '49ff9b68-8be4-4ffd-83d5-4facc22938ed', 'bf441dae-7f1b-4c55-88d8-da09e8b44056', 'a4976df6-2710-452e-8f6c-5a0f5ee11f3f'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4f70f214-e799-4e4e-9c58-633e62d44c9f tempest-VolumesMetadataTest-203126427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4f70f214-e799-4e4e-9c58-633e62d44c9f tempest-VolumesMetadataTest-203126427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4f70f214-e799-4e4e-9c58-633e62d44c9f tempest-VolumesMetadataTest-203126427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4f70f214-e799-4e4e-9c58-633e62d44c9f tempest-VolumesMetadataTest-203126427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4f70f214-e799-4e4e-9c58-633e62d44c9f tempest-VolumesMetadataTest-203126427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4f70f214-e799-4e4e-9c58-633e62d44c9f tempest-VolumesMetadataTest-203126427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:37 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:48:37 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:38 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4f70f214-e799-4e4e-9c58-633e62d44c9f tempest-VolumesMetadataTest-203126427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.257s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:38 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-4f70f214-e799-4e4e-9c58-633e62d44c9f tempest-VolumesMetadataTest-203126427 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:48:38 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-4f70f214-e799-4e4e-9c58-633e62d44c9f tempest-VolumesMetadataTest-203126427 None] Deleted volume successfully. Nov 05 03:48:38 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4f70f214-e799-4e4e-9c58-633e62d44c9f tempest-VolumesMetadataTest-203126427 None] Lock "cinder-e0807872-55a1-4e15-a02f-412f574c7f89-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:39 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] group_snapshot 8c593a33-f3da-4c76-b276-8d811d09d9d5: deleting Nov 05 03:48:39 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] group_snapshot 8c593a33-f3da-4c76-b276-8d811d09d9d5: deleting {{(pid=87109) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4371}} Nov 05 03:48:39 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "cinder-quobyte-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:39 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:39 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "cinder-quobyte-90a17f56-9a1b-455e-9b99-eacf989cbdc8" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:39 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-90a17f56-9a1b-455e-9b99-eacf989cbdc8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] Deleting offline snapshot 90a17f56-9a1b-455e-9b99-eacf989cbdc8 of volume b7c6040f-6ba3-40d5-9288-d0eef6d8c52a {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:48:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] snapshot_file for this snap is: volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.90a17f56-9a1b-455e-9b99-eacf989cbdc8 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:48:39 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7355b09-d9cc-41de-a7e1-c646d06a468f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.90a17f56-9a1b-455e-9b99-eacf989cbdc8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:39 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.90a17f56-9a1b-455e-9b99-eacf989cbdc8 Nov 05 03:48:39 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:39 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.90a17f56-9a1b-455e-9b99-eacf989cbdc8" returned: 0 in 0.522s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:48:39 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[210045ea-d668-4386-b794-fe25224ef209]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:40 devstack sudo[95774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a Nov 05 03:48:40 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:40 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a" returned: 0 in 0.496s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.90a17f56-9a1b-455e-9b99-eacf989cbdc8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:40 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.90a17f56-9a1b-455e-9b99-eacf989cbdc8 Nov 05 03:48:40 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:40 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.90a17f56-9a1b-455e-9b99-eacf989cbdc8" returned: 0 in 0.534s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.90a17f56-9a1b-455e-9b99-eacf989cbdc8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:40 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.90a17f56-9a1b-455e-9b99-eacf989cbdc8 Nov 05 03:48:40 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:41 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a.90a17f56-9a1b-455e-9b99-eacf989cbdc8" returned: 0 in 0.356s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-90a17f56-9a1b-455e-9b99-eacf989cbdc8" released by "_delete_snapshot" :: held 2.099s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a" released by "delete_snapshot" :: held 2.130s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:41 devstack cinder-volume[87109]: WARNING cinder.quota [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1768303565 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1768303565, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:48:41 devstack cinder-volume[87109]: WARNING cinder.quota [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1768303565 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1768303565, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] Created reservations ['1c6e9bea-1aae-48c6-80ef-32749dd6d509', '628ae348-5867-4c72-b272-21edcf04299b', '807b510f-a178-4600-95a4-4d9f9f9fb072', 'f9b33d96-62c2-4df1-97cd-e66c9b4fc7b2'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:41 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f7fd1f61-06d4-41a9-9075-4311e3c7123c tempest-GroupSnapshotsTest-2038618516 None] group_snapshot 8c593a33-f3da-4c76-b276-8d811d09d9d5: deleted successfully Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Flow 'volume_create_manager' (72b1d5dd-63ea-40ef-a97e-301773ede08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62bfa3ed-6af1-486b-adaf-d508d6f8f103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62bfa3ed-6af1-486b-adaf-d508d6f8f103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2017694079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c11d94b-b18d-4f00-ad25-6c832ab90e4c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='33bfe7486a4c4856b319e901309c9970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:42Z,use_quota=True,user_id='4b2b54ffcf1d445983f8a6353e9498d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6d5a53-4fbe-4df6-9dc6-708aa1977a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6d5a53-4fbe-4df6-9dc6-708aa1977a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3f9901-be71-409d-82b1-841f0bbd7f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3f9901-be71-409d-82b1-841f0bbd7f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c11d94b-b18d-4f00-ad25-6c832ab90e4c', 'volume_name': 'volume-1c11d94b-b18d-4f00-ad25-6c832ab90e4c', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f89145-37f8-4df3-9a0d-41736f3650bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f89145-37f8-4df3-9a0d-41736f3650bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a032a1f-7ef7-407d-904a-c96fad88778b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:41 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Volume 1c11d94b-b18d-4f00-ad25-6c832ab90e4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c11d94b-b18d-4f00-ad25-6c832ab90e4c', 'volume_size': 1} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2017694079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c11d94b-b18d-4f00-ad25-6c832ab90e4c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='33bfe7486a4c4856b319e901309c9970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:42Z,use_quota=True,user_id='4b2b54ffcf1d445983f8a6353e9498d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Creating volume 1c11d94b-b18d-4f00-ad25-6c832ab90e4c {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:48:41 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:48:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1c11d94b-b18d-4f00-ad25-6c832ab90e4c 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:41 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1c11d94b-b18d-4f00-ad25-6c832ab90e4c 1073741824 Nov 05 03:48:41 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:42 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1c11d94b-b18d-4f00-ad25-6c832ab90e4c 1073741824" returned: 0 in 0.504s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1c11d94b-b18d-4f00-ad25-6c832ab90e4c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:42 devstack sudo[95795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1c11d94b-b18d-4f00-ad25-6c832ab90e4c Nov 05 03:48:42 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:42 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1c11d94b-b18d-4f00-ad25-6c832ab90e4c" returned: 0 in 0.308s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:42 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:48:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a032a1f-7ef7-407d-904a-c96fad88778b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c11d94b-b18d-4f00-ad25-6c832ab90e4c', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69cc36cb-7d28-403d-8b81-4a0f6d663071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:42 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Volume volume-1c11d94b-b18d-4f00-ad25-6c832ab90e4c (1c11d94b-b18d-4f00-ad25-6c832ab90e4c): created successfully Nov 05 03:48:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69cc36cb-7d28-403d-8b81-4a0f6d663071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Flow 'volume_create_manager' (72b1d5dd-63ea-40ef-a97e-301773ede08d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:42 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-d3d3d5ec-4857-48fe-817a-6199cdf354b1 tempest-VolumesGetTest-259433862 None] Created volume successfully. Nov 05 03:48:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6e8abb01-ee7c-4019-a2b5-e22ca71c4e75 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "cinder-quobyte-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6e8abb01-ee7c-4019-a2b5-e22ca71c4e75 tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a" acquired by "delete_volume" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:43 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e529890f-a06e-4637-91c2-5975eb5bf3df]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6e8abb01-ee7c-4019-a2b5-e22ca71c4e75 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:43 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a Nov 05 03:48:43 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:43 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6e8abb01-ee7c-4019-a2b5-e22ca71c4e75 tempest-GroupSnapshotsTest-2038618516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a" returned: 0 in 0.403s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6e8abb01-ee7c-4019-a2b5-e22ca71c4e75 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:43 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a Nov 05 03:48:43 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:43 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6e8abb01-ee7c-4019-a2b5-e22ca71c4e75 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a" returned: 0 in 0.302s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6e8abb01-ee7c-4019-a2b5-e22ca71c4e75 tempest-GroupSnapshotsTest-2038618516 None] Lock "cinder-quobyte-b7c6040f-6ba3-40d5-9288-d0eef6d8c52a" released by "delete_volume" :: held 0.796s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:43 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-6e8abb01-ee7c-4019-a2b5-e22ca71c4e75 tempest-GroupSnapshotsTest-2038618516 None] Created reservations ['1a13a946-9bc9-4704-9de3-3f7852ec090d'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:43 devstack cinder-volume[87109]: WARNING cinder.quota [None req-6e8abb01-ee7c-4019-a2b5-e22ca71c4e75 tempest-GroupSnapshotsTest-2038618516 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1768303565 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1768303565, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-6e8abb01-ee7c-4019-a2b5-e22ca71c4e75 tempest-GroupSnapshotsTest-2038618516 None] Created reservations ['9fdcb176-78ca-43fe-96e4-c8063b571e78', '9308d7d3-1c84-4980-985e-28cc8e28ac69', 'b268e647-f582-4db6-babf-76bd8a4d9d8c', '66b4e448-fc6a-420b-b539-840ebf0e680f'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6e8abb01-ee7c-4019-a2b5-e22ca71c4e75 tempest-GroupSnapshotsTest-2038618516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6e8abb01-ee7c-4019-a2b5-e22ca71c4e75 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6e8abb01-ee7c-4019-a2b5-e22ca71c4e75 tempest-GroupSnapshotsTest-2038618516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6e8abb01-ee7c-4019-a2b5-e22ca71c4e75 tempest-GroupSnapshotsTest-2038618516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6e8abb01-ee7c-4019-a2b5-e22ca71c4e75 tempest-GroupSnapshotsTest-2038618516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6e8abb01-ee7c-4019-a2b5-e22ca71c4e75 tempest-GroupSnapshotsTest-2038618516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:44 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:48:44 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Flow 'volume_create_manager' (8c6dbaf6-03a2-4095-99c1-c2c79063c262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a719b4-6c8d-4de0-8ef0-6a9a264a4855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a719b4-6c8d-4de0-8ef0-6a9a264a4855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-250560785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b92a36b-84af-4de5-84e7-9468ab5ab9b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5651f21945491ea6990578613f1f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:44Z,use_quota=True,user_id='77f2423b4471428ab30806c93babfda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07663f7e-430f-4215-a229-1818140286da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07663f7e-430f-4215-a229-1818140286da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdeb6c23-8afb-4ca7-9e2a-1999e5063369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdeb6c23-8afb-4ca7-9e2a-1999e5063369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b92a36b-84af-4de5-84e7-9468ab5ab9b4', 'volume_name': 'volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934078c8-5734-49fe-8734-cff34937cd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934078c8-5734-49fe-8734-cff34937cd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e39d37c-0be8-427e-99cf-1072a0a5e813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:44 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Volume 2b92a36b-84af-4de5-84e7-9468ab5ab9b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4', 'volume_size': 1} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-250560785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b92a36b-84af-4de5-84e7-9468ab5ab9b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5651f21945491ea6990578613f1f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:44Z,use_quota=True,user_id='77f2423b4471428ab30806c93babfda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Creating volume 2b92a36b-84af-4de5-84e7-9468ab5ab9b4 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:48:44 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:44 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6e8abb01-ee7c-4019-a2b5-e22ca71c4e75 tempest-GroupSnapshotsTest-2038618516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.478s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:44 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-6e8abb01-ee7c-4019-a2b5-e22ca71c4e75 tempest-GroupSnapshotsTest-2038618516 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:48:44 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-6e8abb01-ee7c-4019-a2b5-e22ca71c4e75 tempest-GroupSnapshotsTest-2038618516 None] Delete group completed successfully. Nov 05 03:48:44 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 1073741824 Nov 05 03:48:44 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:45 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Flow 'volume_create_manager' (d0113bb4-1a6b-4fe0-a206-65f0de329242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4e1a1f-29f7-4bdd-83ad-e9eb8aa95426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 1073741824" returned: 0 in 0.727s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4e1a1f-29f7-4bdd-83ad-e9eb8aa95426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1033462322',display_name='tempest-VolumesGetTest-Volume-853185490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bfe7486a4c4856b319e901309c9970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:45Z,use_quota=True,user_id='4b2b54ffcf1d445983f8a6353e9498d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b55421d-ba2a-44da-a1e8-b1098aa0804c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b55421d-ba2a-44da-a1e8-b1098aa0804c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850649c0-8618-4bf5-9f94-3c4a5a917158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850649c0-8618-4bf5-9f94-3c4a5a917158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd', 'volume_name': 'volume-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6fc6a8-ad5b-4592-b06a-e4a9145f701c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6fc6a8-ad5b-4592-b06a-e4a9145f701c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5402b7e8-3288-4b76-981b-787f99111e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:45 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Volume c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd', 'volume_size': 1} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:45 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 Nov 05 03:48:45 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:45 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4" returned: 0 in 0.259s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.295s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1033462322',display_name='tempest-VolumesGetTest-Volume-853185490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bfe7486a4c4856b319e901309c9970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:45Z,use_quota=True,user_id='4b2b54ffcf1d445983f8a6353e9498d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Creating volume c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:48:45 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e39d37c-0be8-427e-99cf-1072a0a5e813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f25362d-c296-4d04-8d71-e5163c655c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:45 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd 1073741824 Nov 05 03:48:45 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:45 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Volume volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 (2b92a36b-84af-4de5-84e7-9468ab5ab9b4): created successfully Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f25362d-c296-4d04-8d71-e5163c655c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Flow 'volume_create_manager' (8c6dbaf6-03a2-4095-99c1-c2c79063c262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:45 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-d4c073c4-1d53-4ee0-bfbc-3a8a00726b84 tempest-VolumesCloneTest-1393985680 None] Created volume successfully. Nov 05 03:48:46 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd 1073741824" returned: 0 in 0.488s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:46 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd Nov 05 03:48:46 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:46 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd" returned: 0 in 0.289s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:48:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5402b7e8-3288-4b76-981b-787f99111e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a3f3548-2bfe-4b6a-a8cf-2b61c360a5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:46 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Volume volume-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd (c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd): created successfully Nov 05 03:48:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a3f3548-2bfe-4b6a-a8cf-2b61c360a5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Flow 'volume_create_manager' (d0113bb4-1a6b-4fe0-a206-65f0de329242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:46 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-7a47c2e2-4c62-4617-82aa-dfd7a047501f tempest-VolumesGetTest-259433862 None] Created volume successfully. Nov 05 03:48:46 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:48:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Flow 'volume_create_manager' (9489c721-7cb5-417d-8c52-7b3af51ae02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee70bd9-1526-4915-84cf-6e972d6f1d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee70bd9-1526-4915-84cf-6e972d6f1d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1889003452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5651f21945491ea6990578613f1f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=2b92a36b-84af-4de5-84e7-9468ab5ab9b4,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:47Z,use_quota=True,user_id='77f2423b4471428ab30806c93babfda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41712337-5bfb-4435-8517-7b7ea9e024a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41712337-5bfb-4435-8517-7b7ea9e024a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dabcbce-d82b-4269-8bac-fbe4c6b791bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dabcbce-d82b-4269-8bac-fbe4c6b791bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d', 'volume_name': 'volume-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d', 'volume_size': 2, 'source_volid': '2b92a36b-84af-4de5-84e7-9468ab5ab9b4', 'source_volstatus': 'available'}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f716780e-ab86-4868-b90e-4a63f831aeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f716780e-ab86-4868-b90e-4a63f831aeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59be016b-b0c3-4d30-aee8-d566196e1421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:47 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Volume 33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d', 'volume_size': 2, 'source_volid': '2b92a36b-84af-4de5-84e7-9468ab5ab9b4', 'source_volstatus': 'available'} Nov 05 03:48:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:47 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Cloning volume 2b92a36b-84af-4de5-84e7-9468ab5ab9b4 to volume 33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d Nov 05 03:48:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Creating offline snapshot d61f7c4e-41e5-4c61-a889-bfbd41c94719 of volume 2b92a36b-84af-4de5-84e7-9468ab5ab9b4 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:48:47 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff8cd26-6fb8-493a-a8ef-8c6ae9a112f1]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:47 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 Nov 05 03:48:47 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8db80546-e1e7-413f-a24b-89609a3e8d9d tempest-VolumesGetTest-259433862 None] Acquiring lock "cinder-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8db80546-e1e7-413f-a24b-89609a3e8d9d tempest-VolumesGetTest-259433862 None] Lock "cinder-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:47 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4" returned: 0 in 0.467s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:47 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719 1G Nov 05 03:48:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8db80546-e1e7-413f-a24b-89609a3e8d9d tempest-VolumesGetTest-259433862 None] Acquiring lock "cinder-quobyte-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:47 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8db80546-e1e7-413f-a24b-89609a3e8d9d tempest-VolumesGetTest-259433862 None] Lock "cinder-quobyte-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd" acquired by "delete_volume" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:47 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5602a91a-f507-497a-9ea6-f67b24865388]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8db80546-e1e7-413f-a24b-89609a3e8d9d tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:47 devstack sudo[95863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd Nov 05 03:48:47 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:48 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719 1G" returned: 0 in 0.510s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:48 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8db80546-e1e7-413f-a24b-89609a3e8d9d tempest-VolumesGetTest-259433862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd" returned: 0 in 0.432s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8db80546-e1e7-413f-a24b-89609a3e8d9d tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:48 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719 Nov 05 03:48:48 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:48 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd Nov 05 03:48:48 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:48 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8db80546-e1e7-413f-a24b-89609a3e8d9d tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd" returned: 0 in 0.269s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8db80546-e1e7-413f-a24b-89609a3e8d9d tempest-VolumesGetTest-259433862 None] Lock "cinder-quobyte-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd" released by "delete_volume" :: held 0.759s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:48 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719" returned: 0 in 0.325s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:48 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719 is being set with open permissions: ugo+rw Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:48 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719 Nov 05 03:48:48 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-8db80546-e1e7-413f-a24b-89609a3e8d9d tempest-VolumesGetTest-259433862 None] Created reservations ['71d7082d-00e3-4c2b-97a5-f1d66b8a5dd9', 'ddaf7c93-a856-4cf8-9fa9-03a49a5095c6', '83f10d0a-86b7-4150-a8db-8c034ec8c159', '10eb378e-6e19-4f00-a3b4-32a0a66639a0'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8db80546-e1e7-413f-a24b-89609a3e8d9d tempest-VolumesGetTest-259433862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8db80546-e1e7-413f-a24b-89609a3e8d9d tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8db80546-e1e7-413f-a24b-89609a3e8d9d tempest-VolumesGetTest-259433862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8db80546-e1e7-413f-a24b-89609a3e8d9d tempest-VolumesGetTest-259433862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8db80546-e1e7-413f-a24b-89609a3e8d9d tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8db80546-e1e7-413f-a24b-89609a3e8d9d tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:48 devstack sudo[95882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:48:48 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:48 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719" returned: 0 in 0.287s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-28de82cd-416f-409b-9c49-67f7586219cf tempest-VolumesGetTest-259433862 None] Acquiring lock "cinder-1c11d94b-b18d-4f00-ad25-6c832ab90e4c-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:48 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.info Nov 05 03:48:48 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-28de82cd-416f-409b-9c49-67f7586219cf tempest-VolumesGetTest-259433862 None] Lock "cinder-1c11d94b-b18d-4f00-ad25-6c832ab90e4c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-28de82cd-416f-409b-9c49-67f7586219cf tempest-VolumesGetTest-259433862 None] Acquiring lock "cinder-quobyte-1c11d94b-b18d-4f00-ad25-6c832ab90e4c" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-28de82cd-416f-409b-9c49-67f7586219cf tempest-VolumesGetTest-259433862 None] Lock "cinder-quobyte-1c11d94b-b18d-4f00-ad25-6c832ab90e4c" acquired by "delete_volume" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:48 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8db80546-e1e7-413f-a24b-89609a3e8d9d tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.380s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-8db80546-e1e7-413f-a24b-89609a3e8d9d tempest-VolumesGetTest-259433862 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:48:48 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-8db80546-e1e7-413f-a24b-89609a3e8d9d tempest-VolumesGetTest-259433862 None] Deleted volume successfully. Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[41956bca-4cbd-4560-be70-39c38fd5f0b0]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-28de82cd-416f-409b-9c49-67f7586219cf tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1c11d94b-b18d-4f00-ad25-6c832ab90e4c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8db80546-e1e7-413f-a24b-89609a3e8d9d tempest-VolumesGetTest-259433862 None] Lock "cinder-c7e3df42-d0c5-49e7-ac47-9c4ee3ef11fd-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:49 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.info" returned: 0 in 0.367s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:49 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.info is being set with open permissions: ugo+rw Nov 05 03:48:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:49 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1c11d94b-b18d-4f00-ad25-6c832ab90e4c Nov 05 03:48:49 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:49 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.info Nov 05 03:48:49 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:49 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.info" returned: 0 in 0.271s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Acquiring lock "cinder-quobyte-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d" by "_copy_volume_from_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:49 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-28de82cd-416f-409b-9c49-67f7586219cf tempest-VolumesGetTest-259433862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1c11d94b-b18d-4f00-ad25-6c832ab90e4c" returned: 0 in 0.458s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-28de82cd-416f-409b-9c49-67f7586219cf tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1c11d94b-b18d-4f00-ad25-6c832ab90e4c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Lock "cinder-quobyte-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:49 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] snapshot: d61f7c4e-41e5-4c61-a889-bfbd41c94719, volume: 33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d, {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 03:48:49 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1c11d94b-b18d-4f00-ad25-6c832ab90e4c Nov 05 03:48:49 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:49 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:49 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:49 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba5f993-bffa-455b-a5b3-762bedb93f46]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:49 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719 Nov 05 03:48:49 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:49 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-28de82cd-416f-409b-9c49-67f7586219cf tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1c11d94b-b18d-4f00-ad25-6c832ab90e4c" returned: 0 in 0.315s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-28de82cd-416f-409b-9c49-67f7586219cf tempest-VolumesGetTest-259433862 None] Lock "cinder-quobyte-1c11d94b-b18d-4f00-ad25-6c832ab90e4c" released by "delete_volume" :: held 0.869s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:49 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-28de82cd-416f-409b-9c49-67f7586219cf tempest-VolumesGetTest-259433862 None] Created reservations ['a3563485-79fc-4f44-a7bd-4e69a20df75c', '1e69eb10-fe4d-4362-bead-35c8c5694ba6', '6f67b4b3-7fc9-4fec-bb7f-71c12e14e869', '93b7577a-3ddd-4ffa-af21-1539b81459a6'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-28de82cd-416f-409b-9c49-67f7586219cf tempest-VolumesGetTest-259433862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-28de82cd-416f-409b-9c49-67f7586219cf tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-28de82cd-416f-409b-9c49-67f7586219cf tempest-VolumesGetTest-259433862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-28de82cd-416f-409b-9c49-67f7586219cf tempest-VolumesGetTest-259433862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-28de82cd-416f-409b-9c49-67f7586219cf tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-28de82cd-416f-409b-9c49-67f7586219cf tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:50 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:48:50 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:50 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719" returned: 0 in 0.564s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:48:50 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e45e643-e379-4cbc-b575-a11bac7dad10]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:50 devstack sudo[95911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 Nov 05 03:48:50 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:50 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-28de82cd-416f-409b-9c49-67f7586219cf tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.277s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:50 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-28de82cd-416f-409b-9c49-67f7586219cf tempest-VolumesGetTest-259433862 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:48:50 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-28de82cd-416f-409b-9c49-67f7586219cf tempest-VolumesGetTest-259433862 None] Deleted volume successfully. Nov 05 03:48:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-28de82cd-416f-409b-9c49-67f7586219cf tempest-VolumesGetTest-259433862 None] Lock "cinder-1c11d94b-b18d-4f00-ad25-6c832ab90e4c-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:50 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4" returned: 0 in 0.398s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 03:48:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Creating direct copy from snapshot {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 03:48:50 devstack cinder-volume[87109]: DEBUG cinder.utils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Path /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d not found in is_blk_device check {{(pid=87109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 03:48:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:50 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d Nov 05 03:48:50 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:52 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-1ebd5e56-0776-47cc-b397-506db972a4da tempest-GroupsV320Test-1945489735 None] Group tempest-GroupsV320Test-Group-1977844854: creating Nov 05 03:48:52 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:48:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Flow 'volume_create_manager' (bdbb10c6-af4f-41cd-a841-cef7e6b5eb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:48:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09191a3a-6bbc-415a-9757-68d73773dfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:52 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-1ebd5e56-0776-47cc-b397-506db972a4da tempest-GroupsV320Test-1945489735 None] Group tempest-GroupsV320Test-Group-1977844854: created successfully Nov 05 03:48:52 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-1ebd5e56-0776-47cc-b397-506db972a4da tempest-GroupsV320Test-1945489735 None] Create group completed successfully. Nov 05 03:48:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09191a3a-6bbc-415a-9757-68d73773dfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-172676802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800dcf24-2c78-48b7-b0d4-f8cb2ece5320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bfe7486a4c4856b319e901309c9970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:52Z,use_quota=True,user_id='4b2b54ffcf1d445983f8a6353e9498d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c351be9-6d64-45e2-b696-5df73a0a965d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c351be9-6d64-45e2-b696-5df73a0a965d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8203cb5a-01da-435a-8b86-43b990fbf989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8203cb5a-01da-435a-8b86-43b990fbf989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '800dcf24-2c78-48b7-b0d4-f8cb2ece5320', 'volume_name': 'volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9644def8-e215-4e86-ab84-c8521feae70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9644def8-e215-4e86-ab84-c8521feae70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:48:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7353581-8716-4ceb-9b00-045d8ad283cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:48:52 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Volume 800dcf24-2c78-48b7-b0d4-f8cb2ece5320: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320', 'volume_size': 1} Nov 05 03:48:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:54 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-79e5c069-0052-4e71-8810-cb04b246a017 tempest-GroupsV320Test-1945489735 None] Created reservations ['82d0793d-9975-4991-8cde-a99a1640bef4'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:48:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-79e5c069-0052-4e71-8810-cb04b246a017 tempest-GroupsV320Test-1945489735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-79e5c069-0052-4e71-8810-cb04b246a017 tempest-GroupsV320Test-1945489735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-79e5c069-0052-4e71-8810-cb04b246a017 tempest-GroupsV320Test-1945489735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-79e5c069-0052-4e71-8810-cb04b246a017 tempest-GroupsV320Test-1945489735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-79e5c069-0052-4e71-8810-cb04b246a017 tempest-GroupsV320Test-1945489735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-79e5c069-0052-4e71-8810-cb04b246a017 tempest-GroupsV320Test-1945489735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:54 devstack sudo[95930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:48:54 devstack sudo[95930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:54 devstack sudo[95930]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-79e5c069-0052-4e71-8810-cb04b246a017 tempest-GroupsV320Test-1945489735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.560s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:54 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-79e5c069-0052-4e71-8810-cb04b246a017 tempest-GroupsV320Test-1945489735 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:48:54 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-79e5c069-0052-4e71-8810-cb04b246a017 tempest-GroupsV320Test-1945489735 None] Delete group completed successfully. Nov 05 03:48:58 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d" returned: 0 in 7.780s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Image conversion details: src /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4, size 1024.00 MB, duration 7.78 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:48:58 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Converted 1024.00 MB image at 131.59 MB/s Nov 05 03:48:58 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d is being set with open permissions: ugo+rw Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:58 devstack sudo[95960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d Nov 05 03:48:58 devstack sudo[95960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:58 devstack sudo[95962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:48:58 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:58 devstack sudo[95960]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d" returned: 0 in 0.287s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Lock "cinder-quobyte-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d" released by "_copy_volume_from_snapshot" :: held 9.148s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Acquiring lock "cinder-quobyte-d61f7c4e-41e5-4c61-a889-bfbd41c94719" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Lock "cinder-quobyte-d61f7c4e-41e5-4c61-a889-bfbd41c94719" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Deleting offline snapshot d61f7c4e-41e5-4c61-a889-bfbd41c94719 of volume 2b92a36b-84af-4de5-84e7-9468ab5ab9b4 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] snapshot_file for this snap is: volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[07389180-239a-4466-8948-1cfaa7a2624a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:58 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.443s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 28 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:48:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:48:58 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719 Nov 05 03:48:58 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:48:59 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Nov 05 03:48:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719" returned: 0 in 0.556s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:48:59 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:48:59 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[9690c7ea-0468-46dd-b4d6-0f29859159cc]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:48:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:48:59 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 Nov 05 03:48:59 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:00 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4" returned: 0 in 0.703s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:00 devstack sudo[95980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719 Nov 05 03:49:00 devstack sudo[95980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:00 devstack sudo[95980]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719" returned: 0 in 0.462s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:00 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719 Nov 05 03:49:00 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:00 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4.d61f7c4e-41e5-4c61-a889-bfbd41c94719" returned: 0 in 0.329s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Lock "cinder-quobyte-d61f7c4e-41e5-4c61-a889-bfbd41c94719" released by "_delete_snapshot" :: held 2.219s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.886s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.472s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-172676802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800dcf24-2c78-48b7-b0d4-f8cb2ece5320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bfe7486a4c4856b319e901309c9970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:48:52Z,use_quota=True,user_id='4b2b54ffcf1d445983f8a6353e9498d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:49:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Creating volume 800dcf24-2c78-48b7-b0d4-f8cb2ece5320 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:49:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:49:00 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:49:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:01 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 1073741824 Nov 05 03:49:01 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59be016b-b0c3-4d30-aee8-d566196e1421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d', 'volume_size': 2, 'source_volid': '2b92a36b-84af-4de5-84e7-9468ab5ab9b4', 'source_volstatus': 'available'}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd83734-76b5-45b0-9f75-1b2c3578e531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:01 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Volume volume-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d (33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d): created successfully Nov 05 03:49:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffd83734-76b5-45b0-9f75-1b2c3578e531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Flow 'volume_create_manager' (9489c721-7cb5-417d-8c52-7b3af51ae02e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:01 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-cba60211-d33f-4e7a-b92e-0476e6a11224 tempest-VolumesCloneTest-1393985680 None] Created volume successfully. Nov 05 03:49:01 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 1073741824" returned: 0 in 0.715s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:01 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 Nov 05 03:49:01 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-72fd061a-b09b-47d0-a8ac-9fa04b749e91 tempest-VolumesCloneTest-1393985680 None] Acquiring lock "cinder-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-72fd061a-b09b-47d0-a8ac-9fa04b749e91 tempest-VolumesCloneTest-1393985680 None] Lock "cinder-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:02 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-72fd061a-b09b-47d0-a8ac-9fa04b749e91 tempest-VolumesCloneTest-1393985680 None] Acquiring lock "cinder-quobyte-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:02 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-72fd061a-b09b-47d0-a8ac-9fa04b749e91 tempest-VolumesCloneTest-1393985680 None] Lock "cinder-quobyte-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d" acquired by "delete_volume" :: waited 0.026s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:02 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[773dc395-8053-47df-b9ad-d7e2705b6d1c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-72fd061a-b09b-47d0-a8ac-9fa04b749e91 tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:02 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320" returned: 0 in 0.328s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:02 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:49:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:02 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7353581-8716-4ceb-9b00-045d8ad283cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:02 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39dc9e95-575b-44e7-9fa7-f9f821941c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:02 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Volume volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 (800dcf24-2c78-48b7-b0d4-f8cb2ece5320): created successfully Nov 05 03:49:02 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39dc9e95-575b-44e7-9fa7-f9f821941c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:02 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Flow 'volume_create_manager' (bdbb10c6-af4f-41cd-a841-cef7e6b5eb7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:02 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-47b1cb55-83df-463a-b7e8-bbafa1b2b12e tempest-VolumesGetTest-259433862 None] Created volume successfully. Nov 05 03:49:02 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d Nov 05 03:49:02 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:02 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-72fd061a-b09b-47d0-a8ac-9fa04b749e91 tempest-VolumesCloneTest-1393985680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d" returned: 0 in 0.539s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-72fd061a-b09b-47d0-a8ac-9fa04b749e91 tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:02 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d Nov 05 03:49:02 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:02 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-ed7a7d9e-47c2-460f-a4c5-05bb6d4e57ab req-d5f10747-7b78-44fe-9935-85adcc2951e5 tempest-AttachVolumeNegativeTest-671600555 None] Terminate volume connection completed successfully. Nov 05 03:49:02 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-ed7a7d9e-47c2-460f-a4c5-05bb6d4e57ab req-d5f10747-7b78-44fe-9935-85adcc2951e5 tempest-AttachVolumeNegativeTest-671600555 None] Deleting attachment 18e06462-d07c-4859-9f52-463ab8f82103. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:49:03 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-72fd061a-b09b-47d0-a8ac-9fa04b749e91 tempest-VolumesCloneTest-1393985680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d" returned: 0 in 0.435s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-72fd061a-b09b-47d0-a8ac-9fa04b749e91 tempest-VolumesCloneTest-1393985680 None] Lock "cinder-quobyte-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d" released by "delete_volume" :: held 1.054s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Flow 'volume_create_manager' (2799988f-a6f8-4dbc-9f37-c476ab7362cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9916b165-1295-433b-9f28-e7be601465ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9916b165-1295-433b-9f28-e7be601465ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1876574908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e5aa79-981a-4958-9258-d515dffb7d8d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='33bfe7486a4c4856b319e901309c9970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=800dcf24-2c78-48b7-b0d4-f8cb2ece5320,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:03Z,use_quota=True,user_id='4b2b54ffcf1d445983f8a6353e9498d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0648fd1a-ce56-4764-960e-8897fef4c11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0648fd1a-ce56-4764-960e-8897fef4c11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a916f4b-32b5-48ab-a045-de8d9a62caee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a916f4b-32b5-48ab-a045-de8d9a62caee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '86e5aa79-981a-4958-9258-d515dffb7d8d', 'volume_name': 'volume-86e5aa79-981a-4958-9258-d515dffb7d8d', 'volume_size': 1, 'source_volid': '800dcf24-2c78-48b7-b0d4-f8cb2ece5320', 'source_volstatus': 'available'}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87483f54-5b88-4796-bd75-66a41c4757ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87483f54-5b88-4796-bd75-66a41c4757ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9adbf69-7182-4c55-aef0-65ae1640595c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:03 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Volume 86e5aa79-981a-4958-9258-d515dffb7d8d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-86e5aa79-981a-4958-9258-d515dffb7d8d', 'volume_size': 1, 'source_volid': '800dcf24-2c78-48b7-b0d4-f8cb2ece5320', 'source_volstatus': 'available'} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-72fd061a-b09b-47d0-a8ac-9fa04b749e91 tempest-VolumesCloneTest-1393985680 None] Created reservations ['ffcc05ac-e06e-4595-90e0-3a5152baa04c', '31897943-18b7-41b5-a799-ea6cd2ce0e0a', '7b71bfeb-1cab-434b-b4ee-692ca37d38de', 'd4044479-2dde-477d-87c6-034f7969e97b'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:03 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Cloning volume 800dcf24-2c78-48b7-b0d4-f8cb2ece5320 to volume 86e5aa79-981a-4958-9258-d515dffb7d8d Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Creating offline snapshot c87bc216-319c-487e-a650-c204e8ddfa76 of volume 800dcf24-2c78-48b7-b0d4-f8cb2ece5320 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08b23b8-d1c8-492d-bde2-c85d33c14920]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-72fd061a-b09b-47d0-a8ac-9fa04b749e91 tempest-VolumesCloneTest-1393985680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-72fd061a-b09b-47d0-a8ac-9fa04b749e91 tempest-VolumesCloneTest-1393985680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-72fd061a-b09b-47d0-a8ac-9fa04b749e91 tempest-VolumesCloneTest-1393985680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-72fd061a-b09b-47d0-a8ac-9fa04b749e91 tempest-VolumesCloneTest-1393985680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-72fd061a-b09b-47d0-a8ac-9fa04b749e91 tempest-VolumesCloneTest-1393985680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-72fd061a-b09b-47d0-a8ac-9fa04b749e91 tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:03 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:49:03 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:03 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 Nov 05 03:49:03 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:03 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-72fd061a-b09b-47d0-a8ac-9fa04b749e91 tempest-VolumesCloneTest-1393985680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.322s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-72fd061a-b09b-47d0-a8ac-9fa04b749e91 tempest-VolumesCloneTest-1393985680 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:49:03 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-72fd061a-b09b-47d0-a8ac-9fa04b749e91 tempest-VolumesCloneTest-1393985680 None] Deleted volume successfully. Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-72fd061a-b09b-47d0-a8ac-9fa04b749e91 tempest-VolumesCloneTest-1393985680 None] Lock "cinder-33a7f6a7-8d67-4a70-8c7d-41e1a1f6934d-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:03 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320" returned: 0 in 0.518s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:03 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76 1G Nov 05 03:49:03 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:04 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2bf51062-2cc8-4721-b1b3-b06005bf000e tempest-VolumesCloneTest-1393985680 None] Acquiring lock "cinder-2b92a36b-84af-4de5-84e7-9468ab5ab9b4-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:04 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2bf51062-2cc8-4721-b1b3-b06005bf000e tempest-VolumesCloneTest-1393985680 None] Lock "cinder-2b92a36b-84af-4de5-84e7-9468ab5ab9b4-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:04 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:UPDATE=149,cinder:SELECT=174,cinder:DELETE=6,cinder:INSERT=46 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:49:04 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:UPDATE=174,cinder:DELETE=13,cinder:SELECT=156,cinder:INSERT=40 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:49:04 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2bf51062-2cc8-4721-b1b3-b06005bf000e tempest-VolumesCloneTest-1393985680 None] Acquiring lock "cinder-quobyte-2b92a36b-84af-4de5-84e7-9468ab5ab9b4" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:04 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2bf51062-2cc8-4721-b1b3-b06005bf000e tempest-VolumesCloneTest-1393985680 None] Lock "cinder-quobyte-2b92a36b-84af-4de5-84e7-9468ab5ab9b4" acquired by "delete_volume" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:04 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76 1G" returned: 0 in 0.782s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:04 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad6a6f7-2cc2-4b14-bdec-62bea9f44f7b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2bf51062-2cc8-4721-b1b3-b06005bf000e tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:04 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76 Nov 05 03:49:04 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:04 devstack sudo[96045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 Nov 05 03:49:04 devstack sudo[96045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:05 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76" returned: 0 in 0.433s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:05 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76 is being set with open permissions: ugo+rw Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:05 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76 Nov 05 03:49:05 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:05 devstack sudo[96045]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2bf51062-2cc8-4721-b1b3-b06005bf000e tempest-VolumesCloneTest-1393985680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4" returned: 0 in 0.701s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2bf51062-2cc8-4721-b1b3-b06005bf000e tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:05 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4 Nov 05 03:49:05 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:05 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76" returned: 0 in 0.581s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Flow 'volume_create_manager' (a0c90049-39fa-48f3-b0ca-ae641a1736ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969a3162-802b-41b6-b688-0b0119898fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969a3162-802b-41b6-b688-0b0119898fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-902364039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=939e143f-d62d-4096-afc4-9d73eaec9d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf3a76de36aa4737b256e6eb476f404e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:06Z,use_quota=True,user_id='382ebe9850a742f4ba89e7938a72e7a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:05 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4122454e-1806-4cfc-9197-86d8962e818e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:05 devstack sudo[96065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.info Nov 05 03:49:05 devstack sudo[96065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4122454e-1806-4cfc-9197-86d8962e818e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d112e649-86a7-48ac-b3f8-59fea466b5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d112e649-86a7-48ac-b3f8-59fea466b5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '939e143f-d62d-4096-afc4-9d73eaec9d87', 'volume_name': 'volume-939e143f-d62d-4096-afc4-9d73eaec9d87', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c67fb2-dab3-41d7-8c88-c38af6f7d62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c67fb2-dab3-41d7-8c88-c38af6f7d62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5f8420c-93f2-4c74-b526-2cc04774c6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:05 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Volume 939e143f-d62d-4096-afc4-9d73eaec9d87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-939e143f-d62d-4096-afc4-9d73eaec9d87', 'volume_size': 1} Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2bf51062-2cc8-4721-b1b3-b06005bf000e tempest-VolumesCloneTest-1393985680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2b92a36b-84af-4de5-84e7-9468ab5ab9b4" returned: 0 in 0.411s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2bf51062-2cc8-4721-b1b3-b06005bf000e tempest-VolumesCloneTest-1393985680 None] Lock "cinder-quobyte-2b92a36b-84af-4de5-84e7-9468ab5ab9b4" released by "delete_volume" :: held 1.234s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-2bf51062-2cc8-4721-b1b3-b06005bf000e tempest-VolumesCloneTest-1393985680 None] Created reservations ['4f1bd9bb-92df-4f1f-b4ba-668edece6e1d', '6e03230a-7b92-484c-a130-e0cb71f52c13', '3da4e68b-63bd-4b5d-9817-b577ce3883bf', 'fb723e64-9bae-4482-985c-3bcf1c1e3df8'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2bf51062-2cc8-4721-b1b3-b06005bf000e tempest-VolumesCloneTest-1393985680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2bf51062-2cc8-4721-b1b3-b06005bf000e tempest-VolumesCloneTest-1393985680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2bf51062-2cc8-4721-b1b3-b06005bf000e tempest-VolumesCloneTest-1393985680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2bf51062-2cc8-4721-b1b3-b06005bf000e tempest-VolumesCloneTest-1393985680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2bf51062-2cc8-4721-b1b3-b06005bf000e tempest-VolumesCloneTest-1393985680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2bf51062-2cc8-4721-b1b3-b06005bf000e tempest-VolumesCloneTest-1393985680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:06 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:49:06 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:06 devstack sudo[96065]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.info" returned: 0 in 0.336s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:06 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.info is being set with open permissions: ugo+rw Nov 05 03:49:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:06 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.info Nov 05 03:49:06 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:06 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2bf51062-2cc8-4721-b1b3-b06005bf000e tempest-VolumesCloneTest-1393985680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.307s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:06 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-2bf51062-2cc8-4721-b1b3-b06005bf000e tempest-VolumesCloneTest-1393985680 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:49:06 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-2bf51062-2cc8-4721-b1b3-b06005bf000e tempest-VolumesCloneTest-1393985680 None] Deleted volume successfully. Nov 05 03:49:06 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2bf51062-2cc8-4721-b1b3-b06005bf000e tempest-VolumesCloneTest-1393985680 None] Lock "cinder-2b92a36b-84af-4de5-84e7-9468ab5ab9b4-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.info" returned: 0 in 0.295s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Acquiring lock "cinder-quobyte-86e5aa79-981a-4958-9258-d515dffb7d8d" by "_copy_volume_from_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Lock "cinder-quobyte-86e5aa79-981a-4958-9258-d515dffb7d8d" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] snapshot: c87bc216-319c-487e-a650-c204e8ddfa76, volume: 86e5aa79-981a-4958-9258-d515dffb7d8d, {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 03:49:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:06 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3353bb-8019-4516-8d1e-b7a8f9182567]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:06 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76 Nov 05 03:49:06 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:06 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76" returned: 0 in 0.397s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:49:06 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[63726a87-4d08-4663-97e9-0885e8e3794f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:06 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 Nov 05 03:49:06 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:07 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320" returned: 0 in 0.538s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:07 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 03:49:07 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Creating direct copy from snapshot {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 03:49:07 devstack cinder-volume[87109]: DEBUG cinder.utils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Path /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86e5aa79-981a-4958-9258-d515dffb7d8d not found in is_blk_device check {{(pid=87109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 03:49:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86e5aa79-981a-4958-9258-d515dffb7d8d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:07 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86e5aa79-981a-4958-9258-d515dffb7d8d Nov 05 03:49:07 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:13 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:49:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Flow 'volume_create_manager' (82767f40-b923-4020-868a-96d4a9a4a3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88bcc17d-ee45-4474-b301-f0ba19fc29f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88bcc17d-ee45-4474-b301-f0ba19fc29f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1407899913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=515df8e8-957e-4392-9d45-32a61534210f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6ed745b8cf4f64b4648dc6636b13de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:13Z,use_quota=True,user_id='e6f5a3876c144291a50578cdf3324687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493258cd-d236-4c70-8b43-0897592b4013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493258cd-d236-4c70-8b43-0897592b4013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8978d3d3-bef0-4e4a-9cf7-7aff5b164cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8978d3d3-bef0-4e4a-9cf7-7aff5b164cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '515df8e8-957e-4392-9d45-32a61534210f', 'volume_name': 'volume-515df8e8-957e-4392-9d45-32a61534210f', 'volume_size': 2}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86328c48-e287-4bcd-ab71-75b995ffb9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86328c48-e287-4bcd-ab71-75b995ffb9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b4e622-2261-4e30-b95d-7da46ed24468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:13 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Volume 515df8e8-957e-4392-9d45-32a61534210f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-515df8e8-957e-4392-9d45-32a61534210f', 'volume_size': 2} Nov 05 03:49:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:15 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86e5aa79-981a-4958-9258-d515dffb7d8d" returned: 0 in 8.285s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:15 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Image conversion details: src /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320, size 1024.00 MB, duration 8.29 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86e5aa79-981a-4958-9258-d515dffb7d8d {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:49:15 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Converted 1024.00 MB image at 123.59 MB/s Nov 05 03:49:15 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86e5aa79-981a-4958-9258-d515dffb7d8d is being set with open permissions: ugo+rw Nov 05 03:49:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86e5aa79-981a-4958-9258-d515dffb7d8d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:15 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86e5aa79-981a-4958-9258-d515dffb7d8d Nov 05 03:49:15 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:15 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86e5aa79-981a-4958-9258-d515dffb7d8d" returned: 0 in 0.251s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:15 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Lock "cinder-quobyte-86e5aa79-981a-4958-9258-d515dffb7d8d" released by "_copy_volume_from_snapshot" :: held 9.564s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:15 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Acquiring lock "cinder-quobyte-c87bc216-319c-487e-a650-c204e8ddfa76" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:15 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Lock "cinder-quobyte-c87bc216-319c-487e-a650-c204e8ddfa76" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Deleting offline snapshot c87bc216-319c-487e-a650-c204e8ddfa76 of volume 800dcf24-2c78-48b7-b0d4-f8cb2ece5320 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:49:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] snapshot_file for this snap is: volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:49:16 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd285713-c22d-47e5-9947-34b035e0c83e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:16 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76 Nov 05 03:49:16 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:16 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76" returned: 0 in 0.441s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:49:16 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e3775a-e682-4b19-a679-d69795257e08]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:16 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 Nov 05 03:49:16 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:17 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320" returned: 0 in 0.634s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:17 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76 Nov 05 03:49:17 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:17 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76" returned: 0 in 0.401s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:17 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76 Nov 05 03:49:17 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:17 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320.c87bc216-319c-487e-a650-c204e8ddfa76" returned: 0 in 0.267s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:17 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Lock "cinder-quobyte-c87bc216-319c-487e-a650-c204e8ddfa76" released by "_delete_snapshot" :: held 1.879s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.656s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.120s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-902364039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=939e143f-d62d-4096-afc4-9d73eaec9d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf3a76de36aa4737b256e6eb476f404e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:06Z,use_quota=True,user_id='382ebe9850a742f4ba89e7938a72e7a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:49:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Creating volume 939e143f-d62d-4096-afc4-9d73eaec9d87 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:49:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:49:17 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:49:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:17 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87 1073741824 Nov 05 03:49:17 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9adbf69-7182-4c55-aef0-65ae1640595c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86e5aa79-981a-4958-9258-d515dffb7d8d', 'volume_size': 1, 'source_volid': '800dcf24-2c78-48b7-b0d4-f8cb2ece5320', 'source_volstatus': 'available'}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3ad74d-4ba9-4f97-be36-f00330030331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:17 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Volume volume-86e5aa79-981a-4958-9258-d515dffb7d8d (86e5aa79-981a-4958-9258-d515dffb7d8d): created successfully Nov 05 03:49:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd3ad74d-4ba9-4f97-be36-f00330030331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Flow 'volume_create_manager' (2799988f-a6f8-4dbc-9f37-c476ab7362cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:18 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-9917d162-f95d-4fef-a341-569fc6882186 tempest-VolumesGetTest-259433862 None] Created volume successfully. Nov 05 03:49:18 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87 1073741824" returned: 0 in 0.574s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:18 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87 Nov 05 03:49:18 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:18 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87" returned: 0 in 0.277s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:49:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.217s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1407899913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=515df8e8-957e-4392-9d45-32a61534210f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b6ed745b8cf4f64b4648dc6636b13de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:13Z,use_quota=True,user_id='e6f5a3876c144291a50578cdf3324687',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:49:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Creating volume 515df8e8-957e-4392-9d45-32a61534210f {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:49:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:49:18 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:49:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-515df8e8-957e-4392-9d45-32a61534210f 2147483648 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5f8420c-93f2-4c74-b526-2cc04774c6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-939e143f-d62d-4096-afc4-9d73eaec9d87', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:18 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-515df8e8-957e-4392-9d45-32a61534210f 2147483648 Nov 05 03:49:18 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab4fa02-e18a-418e-a53f-604e5a360539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:18 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Volume volume-939e143f-d62d-4096-afc4-9d73eaec9d87 (939e143f-d62d-4096-afc4-9d73eaec9d87): created successfully Nov 05 03:49:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab4fa02-e18a-418e-a53f-604e5a360539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Flow 'volume_create_manager' (a0c90049-39fa-48f3-b0ca-ae641a1736ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:18 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-9edb01a6-cf51-463e-8bd9-0d290f03f5c9 tempest-SnapshotsActionsTest-2007645282 None] Created volume successfully. Nov 05 03:49:19 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:49:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Flow 'volume_create_manager' (7bcc0131-bcfe-4441-9a35-ee6a8cda364e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb275f4-1ad6-4c67-b358-8e4d75a41e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb275f4-1ad6-4c67-b358-8e4d75a41e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1753616258',display_name='tempest-VolumesGetTest-Volume-1300135442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a7eeaf-97f9-4a71-b241-002824f4e773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bfe7486a4c4856b319e901309c9970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:20Z,use_quota=True,user_id='4b2b54ffcf1d445983f8a6353e9498d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ede30cb-3c1b-4756-90f1-e47b608e0ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ede30cb-3c1b-4756-90f1-e47b608e0ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:19 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350bc4fc-61b9-4052-ba44-9717f9844729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350bc4fc-61b9-4052-ba44-9717f9844729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10a7eeaf-97f9-4a71-b241-002824f4e773', 'volume_name': 'volume-10a7eeaf-97f9-4a71-b241-002824f4e773', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6cfbc2-d0b1-4829-99b9-3db3667f255e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6cfbc2-d0b1-4829-99b9-3db3667f255e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3610a5cf-56ed-47b5-af79-503426078742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:20 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Volume 10a7eeaf-97f9-4a71-b241-002824f4e773: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10a7eeaf-97f9-4a71-b241-002824f4e773', 'volume_size': 1} Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-515df8e8-957e-4392-9d45-32a61534210f 2147483648" returned: 0 in 1.190s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-515df8e8-957e-4392-9d45-32a61534210f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:20 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-515df8e8-957e-4392-9d45-32a61534210f Nov 05 03:49:20 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1e109e1b-e736-4a57-a4fc-0ed30f3ccda6 tempest-SnapshotsActionsTest-2007645282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:20 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-515df8e8-957e-4392-9d45-32a61534210f" returned: 0 in 0.575s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.673s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1753616258',display_name='tempest-VolumesGetTest-Volume-1300135442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10a7eeaf-97f9-4a71-b241-002824f4e773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bfe7486a4c4856b319e901309c9970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:20Z,use_quota=True,user_id='4b2b54ffcf1d445983f8a6353e9498d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Creating volume 10a7eeaf-97f9-4a71-b241-002824f4e773 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:49:20 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-10a7eeaf-97f9-4a71-b241-002824f4e773 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:20 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-10a7eeaf-97f9-4a71-b241-002824f4e773 1073741824 Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b4e622-2261-4e30-b95d-7da46ed24468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-515df8e8-957e-4392-9d45-32a61534210f', 'volume_size': 2}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:20 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112a05c8-2698-4189-9fa6-e25ef02efc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:20 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Volume volume-515df8e8-957e-4392-9d45-32a61534210f (515df8e8-957e-4392-9d45-32a61534210f): created successfully Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (112a05c8-2698-4189-9fa6-e25ef02efc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Flow 'volume_create_manager' (82767f40-b923-4020-868a-96d4a9a4a3c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:20 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-1c919aea-ecba-4b24-b4d5-66778342f739 tempest-VolumesCloneNegativeTest-849297662 None] Created volume successfully. Nov 05 03:49:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cf18b2f1-d72e-40bd-82bb-ff7dfbef2c2f tempest-VolumesCloneNegativeTest-849297662 None] Acquiring lock "cinder-515df8e8-957e-4392-9d45-32a61534210f-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cf18b2f1-d72e-40bd-82bb-ff7dfbef2c2f tempest-VolumesCloneNegativeTest-849297662 None] Lock "cinder-515df8e8-957e-4392-9d45-32a61534210f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:21 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-10a7eeaf-97f9-4a71-b241-002824f4e773 1073741824" returned: 0 in 0.820s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-10a7eeaf-97f9-4a71-b241-002824f4e773 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cf18b2f1-d72e-40bd-82bb-ff7dfbef2c2f tempest-VolumesCloneNegativeTest-849297662 None] Acquiring lock "cinder-quobyte-515df8e8-957e-4392-9d45-32a61534210f" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:21 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-10a7eeaf-97f9-4a71-b241-002824f4e773 Nov 05 03:49:21 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cf18b2f1-d72e-40bd-82bb-ff7dfbef2c2f tempest-VolumesCloneNegativeTest-849297662 None] Lock "cinder-quobyte-515df8e8-957e-4392-9d45-32a61534210f" acquired by "delete_volume" :: waited 0.035s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:21 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dde5091-551e-41cc-8192-d2a19ae49e91]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cf18b2f1-d72e-40bd-82bb-ff7dfbef2c2f tempest-VolumesCloneNegativeTest-849297662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-515df8e8-957e-4392-9d45-32a61534210f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:21 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-515df8e8-957e-4392-9d45-32a61534210f Nov 05 03:49:21 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:21 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-10a7eeaf-97f9-4a71-b241-002824f4e773" returned: 0 in 0.385s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1e109e1b-e736-4a57-a4fc-0ed30f3ccda6 tempest-SnapshotsActionsTest-2007645282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.349s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3610a5cf-56ed-47b5-af79-503426078742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10a7eeaf-97f9-4a71-b241-002824f4e773', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f10dd3-ae48-46dd-a533-0a474b8260fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-1e109e1b-e736-4a57-a4fc-0ed30f3ccda6 tempest-SnapshotsActionsTest-2007645282 None] Creating offline snapshot a3b88ad7-9e27-4e4b-aa56-a89516370b42 of volume 939e143f-d62d-4096-afc4-9d73eaec9d87 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:49:22 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Volume volume-10a7eeaf-97f9-4a71-b241-002824f4e773 (10a7eeaf-97f9-4a71-b241-002824f4e773): created successfully Nov 05 03:49:22 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1f10dd3-ae48-46dd-a533-0a474b8260fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Flow 'volume_create_manager' (7bcc0131-bcfe-4441-9a35-ee6a8cda364e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8c8ba6-5fbe-46e7-8bd8-be9f3c2108d1]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1e109e1b-e736-4a57-a4fc-0ed30f3ccda6 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cf18b2f1-d72e-40bd-82bb-ff7dfbef2c2f tempest-VolumesCloneNegativeTest-849297662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-515df8e8-957e-4392-9d45-32a61534210f" returned: 0 in 0.425s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cf18b2f1-d72e-40bd-82bb-ff7dfbef2c2f tempest-VolumesCloneNegativeTest-849297662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-515df8e8-957e-4392-9d45-32a61534210f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:22 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-c8ed3c7c-1577-42db-a7bb-c36f169fb480 tempest-VolumesGetTest-259433862 None] Created volume successfully. Nov 05 03:49:22 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-515df8e8-957e-4392-9d45-32a61534210f Nov 05 03:49:22 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:22 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87 Nov 05 03:49:22 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:22 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cf18b2f1-d72e-40bd-82bb-ff7dfbef2c2f tempest-VolumesCloneNegativeTest-849297662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-515df8e8-957e-4392-9d45-32a61534210f" returned: 0 in 0.366s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cf18b2f1-d72e-40bd-82bb-ff7dfbef2c2f tempest-VolumesCloneNegativeTest-849297662 None] Lock "cinder-quobyte-515df8e8-957e-4392-9d45-32a61534210f" released by "delete_volume" :: held 0.861s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:22 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1e109e1b-e736-4a57-a4fc-0ed30f3ccda6 tempest-SnapshotsActionsTest-2007645282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87" returned: 0 in 0.619s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1e109e1b-e736-4a57-a4fc-0ed30f3ccda6 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-cf18b2f1-d72e-40bd-82bb-ff7dfbef2c2f tempest-VolumesCloneNegativeTest-849297662 None] Created reservations ['595cedae-bfa2-40af-a75a-c81ab11f5bc0', '6dc3867c-eb8e-4557-8f38-b7db76ba0a0e', 'c04baf49-44e7-49b2-9ffb-3239ff2ef782', '702f4428-b0e5-4e8c-a0e9-32f740abccee'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:49:22 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 1G Nov 05 03:49:22 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-cf18b2f1-d72e-40bd-82bb-ff7dfbef2c2f tempest-VolumesCloneNegativeTest-849297662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-cf18b2f1-d72e-40bd-82bb-ff7dfbef2c2f tempest-VolumesCloneNegativeTest-849297662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-cf18b2f1-d72e-40bd-82bb-ff7dfbef2c2f tempest-VolumesCloneNegativeTest-849297662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-cf18b2f1-d72e-40bd-82bb-ff7dfbef2c2f tempest-VolumesCloneNegativeTest-849297662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-cf18b2f1-d72e-40bd-82bb-ff7dfbef2c2f tempest-VolumesCloneNegativeTest-849297662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cf18b2f1-d72e-40bd-82bb-ff7dfbef2c2f tempest-VolumesCloneNegativeTest-849297662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:22 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:49:22 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4482f19f-f79e-4b9f-b46c-862d4bc942f1 tempest-VolumesGetTest-259433862 None] Acquiring lock "cinder-10a7eeaf-97f9-4a71-b241-002824f4e773-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4482f19f-f79e-4b9f-b46c-862d4bc942f1 tempest-VolumesGetTest-259433862 None] Lock "cinder-10a7eeaf-97f9-4a71-b241-002824f4e773-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:23 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cf18b2f1-d72e-40bd-82bb-ff7dfbef2c2f tempest-VolumesCloneNegativeTest-849297662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.630s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:23 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-cf18b2f1-d72e-40bd-82bb-ff7dfbef2c2f tempest-VolumesCloneNegativeTest-849297662 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:49:23 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-cf18b2f1-d72e-40bd-82bb-ff7dfbef2c2f tempest-VolumesCloneNegativeTest-849297662 None] Deleted volume successfully. Nov 05 03:49:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cf18b2f1-d72e-40bd-82bb-ff7dfbef2c2f tempest-VolumesCloneNegativeTest-849297662 None] Lock "cinder-515df8e8-957e-4392-9d45-32a61534210f-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4482f19f-f79e-4b9f-b46c-862d4bc942f1 tempest-VolumesGetTest-259433862 None] Acquiring lock "cinder-quobyte-10a7eeaf-97f9-4a71-b241-002824f4e773" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4482f19f-f79e-4b9f-b46c-862d4bc942f1 tempest-VolumesGetTest-259433862 None] Lock "cinder-quobyte-10a7eeaf-97f9-4a71-b241-002824f4e773" acquired by "delete_volume" :: waited 0.036s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:23 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1e109e1b-e736-4a57-a4fc-0ed30f3ccda6 tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 1G" returned: 0 in 0.990s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1e109e1b-e736-4a57-a4fc-0ed30f3ccda6 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939e143f-d62d-4096-afc4-9d73eaec9d87 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:23 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f033e1-0eda-4e06-95d5-a711e95f7d36]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4482f19f-f79e-4b9f-b46c-862d4bc942f1 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-10a7eeaf-97f9-4a71-b241-002824f4e773 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:23 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939e143f-d62d-4096-afc4-9d73eaec9d87 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 Nov 05 03:49:23 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:23 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-10a7eeaf-97f9-4a71-b241-002824f4e773 Nov 05 03:49:23 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:24 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1e109e1b-e736-4a57-a4fc-0ed30f3ccda6 tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939e143f-d62d-4096-afc4-9d73eaec9d87 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42" returned: 0 in 0.511s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:24 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-1e109e1b-e736-4a57-a4fc-0ed30f3ccda6 tempest-SnapshotsActionsTest-2007645282 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 is being set with open permissions: ugo+rw Nov 05 03:49:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1e109e1b-e736-4a57-a4fc-0ed30f3ccda6 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:24 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 Nov 05 03:49:24 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:24 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4482f19f-f79e-4b9f-b46c-862d4bc942f1 tempest-VolumesGetTest-259433862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-10a7eeaf-97f9-4a71-b241-002824f4e773" returned: 0 in 0.587s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4482f19f-f79e-4b9f-b46c-862d4bc942f1 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-10a7eeaf-97f9-4a71-b241-002824f4e773 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:24 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-10a7eeaf-97f9-4a71-b241-002824f4e773 Nov 05 03:49:24 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:24 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1e109e1b-e736-4a57-a4fc-0ed30f3ccda6 tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42" returned: 0 in 0.476s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1e109e1b-e736-4a57-a4fc-0ed30f3ccda6 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:24 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.info Nov 05 03:49:24 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:24 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4482f19f-f79e-4b9f-b46c-862d4bc942f1 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-10a7eeaf-97f9-4a71-b241-002824f4e773" returned: 0 in 0.580s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4482f19f-f79e-4b9f-b46c-862d4bc942f1 tempest-VolumesGetTest-259433862 None] Lock "cinder-quobyte-10a7eeaf-97f9-4a71-b241-002824f4e773" released by "delete_volume" :: held 1.264s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:25 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-4482f19f-f79e-4b9f-b46c-862d4bc942f1 tempest-VolumesGetTest-259433862 None] Created reservations ['509bd190-d441-472a-a061-20530f61c96d', '62340878-aa14-40da-b8a5-934781ea65b3', '7d5225c9-f083-4f08-b1ce-4544248b1764', '909547a2-2510-4da3-b765-c66e242e1316'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:49:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4482f19f-f79e-4b9f-b46c-862d4bc942f1 tempest-VolumesGetTest-259433862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4482f19f-f79e-4b9f-b46c-862d4bc942f1 tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4482f19f-f79e-4b9f-b46c-862d4bc942f1 tempest-VolumesGetTest-259433862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4482f19f-f79e-4b9f-b46c-862d4bc942f1 tempest-VolumesGetTest-259433862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4482f19f-f79e-4b9f-b46c-862d4bc942f1 tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4482f19f-f79e-4b9f-b46c-862d4bc942f1 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:25 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1e109e1b-e736-4a57-a4fc-0ed30f3ccda6 tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.info" returned: 0 in 0.440s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:25 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-1e109e1b-e736-4a57-a4fc-0ed30f3ccda6 tempest-SnapshotsActionsTest-2007645282 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.info is being set with open permissions: ugo+rw Nov 05 03:49:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1e109e1b-e736-4a57-a4fc-0ed30f3ccda6 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:25 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:49:25 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:25 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.info Nov 05 03:49:25 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:25 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4482f19f-f79e-4b9f-b46c-862d4bc942f1 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.406s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:25 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-4482f19f-f79e-4b9f-b46c-862d4bc942f1 tempest-VolumesGetTest-259433862 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:49:25 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-4482f19f-f79e-4b9f-b46c-862d4bc942f1 tempest-VolumesGetTest-259433862 None] Deleted volume successfully. Nov 05 03:49:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4482f19f-f79e-4b9f-b46c-862d4bc942f1 tempest-VolumesGetTest-259433862 None] Lock "cinder-10a7eeaf-97f9-4a71-b241-002824f4e773-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1e109e1b-e736-4a57-a4fc-0ed30f3ccda6 tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.info" returned: 0 in 0.600s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:25 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1e109e1b-e736-4a57-a4fc-0ed30f3ccda6 tempest-SnapshotsActionsTest-2007645282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.876s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:25 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-1e109e1b-e736-4a57-a4fc-0ed30f3ccda6 tempest-SnapshotsActionsTest-2007645282 None] Create snapshot completed successfully Nov 05 03:49:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b3bd23e5-1c41-4290-b3a1-4989c8bbcde0 tempest-VolumesGetTest-259433862 None] Acquiring lock "cinder-86e5aa79-981a-4958-9258-d515dffb7d8d-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b3bd23e5-1c41-4290-b3a1-4989c8bbcde0 tempest-VolumesGetTest-259433862 None] Lock "cinder-86e5aa79-981a-4958-9258-d515dffb7d8d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b3bd23e5-1c41-4290-b3a1-4989c8bbcde0 tempest-VolumesGetTest-259433862 None] Acquiring lock "cinder-quobyte-86e5aa79-981a-4958-9258-d515dffb7d8d" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b3bd23e5-1c41-4290-b3a1-4989c8bbcde0 tempest-VolumesGetTest-259433862 None] Lock "cinder-quobyte-86e5aa79-981a-4958-9258-d515dffb7d8d" acquired by "delete_volume" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:26 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[580096f7-0bed-4019-9d80-005f594be3b9]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b3bd23e5-1c41-4290-b3a1-4989c8bbcde0 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86e5aa79-981a-4958-9258-d515dffb7d8d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:26 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86e5aa79-981a-4958-9258-d515dffb7d8d Nov 05 03:49:26 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:26 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b3bd23e5-1c41-4290-b3a1-4989c8bbcde0 tempest-VolumesGetTest-259433862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86e5aa79-981a-4958-9258-d515dffb7d8d" returned: 0 in 0.507s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b3bd23e5-1c41-4290-b3a1-4989c8bbcde0 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86e5aa79-981a-4958-9258-d515dffb7d8d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:26 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86e5aa79-981a-4958-9258-d515dffb7d8d Nov 05 03:49:26 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:26 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b3bd23e5-1c41-4290-b3a1-4989c8bbcde0 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-86e5aa79-981a-4958-9258-d515dffb7d8d" returned: 0 in 0.286s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b3bd23e5-1c41-4290-b3a1-4989c8bbcde0 tempest-VolumesGetTest-259433862 None] Lock "cinder-quobyte-86e5aa79-981a-4958-9258-d515dffb7d8d" released by "delete_volume" :: held 0.859s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:27 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-b3bd23e5-1c41-4290-b3a1-4989c8bbcde0 tempest-VolumesGetTest-259433862 None] Created reservations ['db911574-2d26-4ba0-9736-68d6ac506cac', '781369d6-267c-44f9-8127-649407461311', 'aa3cf57a-5503-4918-bc39-e232a79226ce', 'd02bd3c1-c7aa-49a3-b272-8fa108978f5c'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:49:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b3bd23e5-1c41-4290-b3a1-4989c8bbcde0 tempest-VolumesGetTest-259433862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b3bd23e5-1c41-4290-b3a1-4989c8bbcde0 tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:27 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b3bd23e5-1c41-4290-b3a1-4989c8bbcde0 tempest-VolumesGetTest-259433862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:27 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b3bd23e5-1c41-4290-b3a1-4989c8bbcde0 tempest-VolumesGetTest-259433862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b3bd23e5-1c41-4290-b3a1-4989c8bbcde0 tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b3bd23e5-1c41-4290-b3a1-4989c8bbcde0 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:27 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:49:27 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:27 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b3bd23e5-1c41-4290-b3a1-4989c8bbcde0 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.327s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:27 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-b3bd23e5-1c41-4290-b3a1-4989c8bbcde0 tempest-VolumesGetTest-259433862 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:49:27 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b3bd23e5-1c41-4290-b3a1-4989c8bbcde0 tempest-VolumesGetTest-259433862 None] Deleted volume successfully. Nov 05 03:49:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b3bd23e5-1c41-4290-b3a1-4989c8bbcde0 tempest-VolumesGetTest-259433862 None] Lock "cinder-86e5aa79-981a-4958-9258-d515dffb7d8d-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1d83fc36-31bb-4e86-b5ba-175254963a05 tempest-SnapshotsActionsTest-2007645282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1d83fc36-31bb-4e86-b5ba-175254963a05 tempest-SnapshotsActionsTest-2007645282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:27 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-1d83fc36-31bb-4e86-b5ba-175254963a05 tempest-SnapshotsActionsTest-2007645282 None] Creating offline snapshot 9a78f17d-ad13-4eda-8cc4-42fcc50883d4 of volume 939e143f-d62d-4096-afc4-9d73eaec9d87 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:49:28 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f810c4-568d-40b1-a4e4-8d4bf65ca4e9]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1d83fc36-31bb-4e86-b5ba-175254963a05 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:28 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 Nov 05 03:49:28 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:28 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1d83fc36-31bb-4e86-b5ba-175254963a05 tempest-SnapshotsActionsTest-2007645282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42" returned: 0 in 0.398s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:28 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-1d83fc36-31bb-4e86-b5ba-175254963a05 tempest-SnapshotsActionsTest-2007645282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939e143f-d62d-4096-afc4-9d73eaec9d87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:49:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1d83fc36-31bb-4e86-b5ba-175254963a05 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.9a78f17d-ad13-4eda-8cc4-42fcc50883d4 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-23d74f6e-e073-4105-b7b9-2019752334d5 tempest-VolumesGetTest-259433862 None] Acquiring lock "cinder-800dcf24-2c78-48b7-b0d4-f8cb2ece5320-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:28 devstack sudo[96361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.9a78f17d-ad13-4eda-8cc4-42fcc50883d4 1G Nov 05 03:49:28 devstack sudo[96361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-23d74f6e-e073-4105-b7b9-2019752334d5 tempest-VolumesGetTest-259433862 None] Lock "cinder-800dcf24-2c78-48b7-b0d4-f8cb2ece5320-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-23d74f6e-e073-4105-b7b9-2019752334d5 tempest-VolumesGetTest-259433862 None] Acquiring lock "cinder-quobyte-800dcf24-2c78-48b7-b0d4-f8cb2ece5320" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-23d74f6e-e073-4105-b7b9-2019752334d5 tempest-VolumesGetTest-259433862 None] Lock "cinder-quobyte-800dcf24-2c78-48b7-b0d4-f8cb2ece5320" acquired by "delete_volume" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:28 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae9f79e-f11c-4113-9d26-ed4085f1cde5]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-23d74f6e-e073-4105-b7b9-2019752334d5 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:28 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 Nov 05 03:49:28 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:29 devstack sudo[96361]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1d83fc36-31bb-4e86-b5ba-175254963a05 tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.9a78f17d-ad13-4eda-8cc4-42fcc50883d4 1G" returned: 0 in 0.631s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1d83fc36-31bb-4e86-b5ba-175254963a05 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.9a78f17d-ad13-4eda-8cc4-42fcc50883d4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:29 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.9a78f17d-ad13-4eda-8cc4-42fcc50883d4 Nov 05 03:49:29 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:29 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-23d74f6e-e073-4105-b7b9-2019752334d5 tempest-VolumesGetTest-259433862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320" returned: 0 in 0.533s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-23d74f6e-e073-4105-b7b9-2019752334d5 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:29 devstack sudo[96375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320 Nov 05 03:49:29 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:29 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1d83fc36-31bb-4e86-b5ba-175254963a05 tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.9a78f17d-ad13-4eda-8cc4-42fcc50883d4" returned: 0 in 0.391s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:29 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-1d83fc36-31bb-4e86-b5ba-175254963a05 tempest-SnapshotsActionsTest-2007645282 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.9a78f17d-ad13-4eda-8cc4-42fcc50883d4 is being set with open permissions: ugo+rw Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1d83fc36-31bb-4e86-b5ba-175254963a05 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.9a78f17d-ad13-4eda-8cc4-42fcc50883d4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:29 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.9a78f17d-ad13-4eda-8cc4-42fcc50883d4 Nov 05 03:49:29 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:49:29 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Flow 'volume_create_manager' (d92c0924-b646-4190-afba-536ae1f255d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295e02a2-f832-450f-b84e-cef99b97d6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-23d74f6e-e073-4105-b7b9-2019752334d5 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-800dcf24-2c78-48b7-b0d4-f8cb2ece5320" returned: 0 in 0.448s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295e02a2-f832-450f-b84e-cef99b97d6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2144102302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd7498d-b527-4ee6-98f0-ca420c2dc970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0426abdfcdf3405381eb7b37917ba502',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:30Z,use_quota=True,user_id='add4cfc8b8b4462e8f7823a9fcd2a2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae69791c-3fc6-49d6-996b-cd85f42dffc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae69791c-3fc6-49d6-996b-cd85f42dffc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5713eeca-d9e9-4731-abcb-ce24897e95a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5713eeca-d9e9-4731-abcb-ce24897e95a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cd7498d-b527-4ee6-98f0-ca420c2dc970', 'volume_name': 'volume-9cd7498d-b527-4ee6-98f0-ca420c2dc970', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caba6cf3-ff39-4ef1-b9c6-1fcbbda95a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caba6cf3-ff39-4ef1-b9c6-1fcbbda95a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4aa5269-dc15-491f-a7d2-e8e7ca64e07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:29 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Volume 9cd7498d-b527-4ee6-98f0-ca420c2dc970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cd7498d-b527-4ee6-98f0-ca420c2dc970', 'volume_size': 1} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-23d74f6e-e073-4105-b7b9-2019752334d5 tempest-VolumesGetTest-259433862 None] Lock "cinder-quobyte-800dcf24-2c78-48b7-b0d4-f8cb2ece5320" released by "delete_volume" :: held 1.117s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-23d74f6e-e073-4105-b7b9-2019752334d5 tempest-VolumesGetTest-259433862 None] Created reservations ['573e1f2b-e419-4b10-be14-0e8bd1b616a9', '389fb19a-4d2a-4c48-92c4-47adee6e782f', '9e5f65a4-f6ee-4f70-bfd2-7e3dcda914ea', '1daaa9d3-a6ac-4d80-b5e7-e2af3ece91ad'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:49:29 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1d83fc36-31bb-4e86-b5ba-175254963a05 tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.9a78f17d-ad13-4eda-8cc4-42fcc50883d4" returned: 0 in 0.332s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1d83fc36-31bb-4e86-b5ba-175254963a05 tempest-SnapshotsActionsTest-2007645282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.905s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.126s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2144102302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cd7498d-b527-4ee6-98f0-ca420c2dc970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0426abdfcdf3405381eb7b37917ba502',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:30Z,use_quota=True,user_id='add4cfc8b8b4462e8f7823a9fcd2a2e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Creating volume 9cd7498d-b527-4ee6-98f0-ca420c2dc970 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:49:29 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9cd7498d-b527-4ee6-98f0-ca420c2dc970 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:29 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9cd7498d-b527-4ee6-98f0-ca420c2dc970 1073741824 Nov 05 03:49:29 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-23d74f6e-e073-4105-b7b9-2019752334d5 tempest-VolumesGetTest-259433862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-23d74f6e-e073-4105-b7b9-2019752334d5 tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-23d74f6e-e073-4105-b7b9-2019752334d5 tempest-VolumesGetTest-259433862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-23d74f6e-e073-4105-b7b9-2019752334d5 tempest-VolumesGetTest-259433862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-23d74f6e-e073-4105-b7b9-2019752334d5 tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-23d74f6e-e073-4105-b7b9-2019752334d5 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:29 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-1d83fc36-31bb-4e86-b5ba-175254963a05 tempest-SnapshotsActionsTest-2007645282 None] Create snapshot completed successfully Nov 05 03:49:29 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:49:29 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] Acquiring lock "cinder-9a78f17d-ad13-4eda-8cc4-42fcc50883d4-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-9a78f17d-ad13-4eda-8cc4-42fcc50883d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] Acquiring lock "cinder-quobyte-939e143f-d62d-4096-afc4-9d73eaec9d87" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-quobyte-939e143f-d62d-4096-afc4-9d73eaec9d87" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] Acquiring lock "cinder-quobyte-9a78f17d-ad13-4eda-8cc4-42fcc50883d4" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:30 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-23d74f6e-e073-4105-b7b9-2019752334d5 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.368s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-23d74f6e-e073-4105-b7b9-2019752334d5 tempest-VolumesGetTest-259433862 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-quobyte-9a78f17d-ad13-4eda-8cc4-42fcc50883d4" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] Deleting offline snapshot 9a78f17d-ad13-4eda-8cc4-42fcc50883d4 of volume 939e143f-d62d-4096-afc4-9d73eaec9d87 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] snapshot_file for this snap is: volume-939e143f-d62d-4096-afc4-9d73eaec9d87.9a78f17d-ad13-4eda-8cc4-42fcc50883d4 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:49:30 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-23d74f6e-e073-4105-b7b9-2019752334d5 tempest-VolumesGetTest-259433862 None] Deleted volume successfully. Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d432939c-434c-4169-ae4a-6178e43c01d1]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.9a78f17d-ad13-4eda-8cc4-42fcc50883d4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-23d74f6e-e073-4105-b7b9-2019752334d5 tempest-VolumesGetTest-259433862 None] Lock "cinder-800dcf24-2c78-48b7-b0d4-f8cb2ece5320-delete_volume" released by "delete_volume" :: held 1.849s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:30 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9cd7498d-b527-4ee6-98f0-ca420c2dc970 1073741824" returned: 0 in 0.565s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9cd7498d-b527-4ee6-98f0-ca420c2dc970 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:30 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.9a78f17d-ad13-4eda-8cc4-42fcc50883d4 Nov 05 03:49:30 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:30 devstack sudo[96396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9cd7498d-b527-4ee6-98f0-ca420c2dc970 Nov 05 03:49:30 devstack sudo[96396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:30 devstack sudo[96396]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9cd7498d-b527-4ee6-98f0-ca420c2dc970" returned: 0 in 0.256s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:30 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4aa5269-dc15-491f-a7d2-e8e7ca64e07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cd7498d-b527-4ee6-98f0-ca420c2dc970', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54aa821-77cf-4f7c-99b6-5a799ec43fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.9a78f17d-ad13-4eda-8cc4-42fcc50883d4" returned: 0 in 0.445s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939e143f-d62d-4096-afc4-9d73eaec9d87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:49:30 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Volume volume-9cd7498d-b527-4ee6-98f0-ca420c2dc970 (9cd7498d-b527-4ee6-98f0-ca420c2dc970): created successfully Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54aa821-77cf-4f7c-99b6-5a799ec43fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Flow 'volume_create_manager' (d92c0924-b646-4190-afba-536ae1f255d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86966a0-72b6-4356-aa48-914bb2700466]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:30 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b520a798-62dd-4653-afcc-765461fc30b9 tempest-VolumesNegativeTest-226258957 None] Created volume successfully. Nov 05 03:49:30 devstack sudo[96402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 Nov 05 03:49:30 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:31 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42" returned: 0 in 0.414s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939e143f-d62d-4096-afc4-9d73eaec9d87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:49:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.9a78f17d-ad13-4eda-8cc4-42fcc50883d4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:31 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.9a78f17d-ad13-4eda-8cc4-42fcc50883d4 Nov 05 03:49:31 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:31 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:49:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Flow 'volume_create_manager' (846418c0-5a68-4c3e-b109-c9858332bc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ad2fe57-d759-47b7-ba35-6a39ed093c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ad2fe57-d759-47b7-ba35-6a39ed093c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1437456609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='33bfe7486a4c4856b319e901309c9970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:32Z,use_quota=True,user_id='4b2b54ffcf1d445983f8a6353e9498d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c036fc-999b-4efb-ad0a-6ffe049f798f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c036fc-999b-4efb-ad0a-6ffe049f798f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54866b4f-8f21-4461-9486-6a3be7b920fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:31 devstack cinder-volume[87109]: DEBUG cinder.image.glance [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Creating Keystone auth plugin from conf {{(pid=87109) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 03:49:31 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.9a78f17d-ad13-4eda-8cc4-42fcc50883d4" returned: 0 in 0.580s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.9a78f17d-ad13-4eda-8cc4-42fcc50883d4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:31 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.9a78f17d-ad13-4eda-8cc4-42fcc50883d4 Nov 05 03:49:31 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:32 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.9a78f17d-ad13-4eda-8cc4-42fcc50883d4" returned: 0 in 0.302s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-quobyte-9a78f17d-ad13-4eda-8cc4-42fcc50883d4" released by "_delete_snapshot" :: held 1.888s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-quobyte-939e143f-d62d-4096-afc4-9d73eaec9d87" released by "delete_snapshot" :: held 1.932s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54866b4f-8f21-4461-9486-6a3be7b920fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2', 'volume_name': 'volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2', 'volume_size': 1, 'image_id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9a2a266d3247698576f415a1551384', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8af958c-b354-4755-b83b-a00f70433bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8af958c-b354-4755-b83b-a00f70433bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d35ac450-5807-4613-b108-1cbc8f6c2e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:32 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Volume f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2', 'volume_size': 1, 'image_id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9a2a266d3247698576f415a1551384', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 03:49:32 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Trying to clone f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2 from image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}]). {{(pid=87109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 03:49:32 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] Created reservations ['1b0f0cf9-a98e-491d-9d4a-7d795a402669', 'b49fb1cc-dbc5-447a-8ab9-493d571585fb', '67868c9b-4be5-43f2-ad06-12956c26fee8', '3ecc8a52-ad90-4d8a-8bf2-c1a2b73e64e6'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:49:32 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] Delete snapshot completed successfully. Nov 05 03:49:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5beb16ca-9533-4ab3-a1a1-e14cbf156463 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-9a78f17d-ad13-4eda-8cc4-42fcc50883d4-delete_snapshot" released by "delete_snapshot" :: held 2.320s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:32 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_83tqlvuydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 05 03:49:32 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Image download 20.69 MB at 20.69 MB/s Nov 05 03:49:32 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[255627f6-58ad-4657-869e-6b9d12a25a52]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_83tqlvuydevstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:32 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_83tqlvuydevstack@QuobyteHD Nov 05 03:49:32 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:33 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_83tqlvuydevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:33 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Temporary image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 is fetched for user 4b2b54ffcf1d445983f8a6353e9498d4. {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 05 03:49:33 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52936ef-3bf5-4778-99a7-1bca4417f413]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_83tqlvuydevstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:33 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_83tqlvuydevstack@QuobyteHD Nov 05 03:49:33 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:33 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_83tqlvuydevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1437456609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='33bfe7486a4c4856b319e901309c9970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:32Z,use_quota=True,user_id='4b2b54ffcf1d445983f8a6353e9498d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:49:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Creating volume f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:49:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:49:33 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:49:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:33 devstack sudo[96431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2 1073741824 Nov 05 03:49:33 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-89c231ff-55de-46d2-983b-418db68982c7 tempest-SnapshotsActionsTest-2007645282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:34 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2 1073741824" returned: 0 in 0.679s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:34 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2 Nov 05 03:49:34 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:34 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2" returned: 0 in 0.318s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:49:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-89c231ff-55de-46d2-983b-418db68982c7 tempest-SnapshotsActionsTest-2007645282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.723s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-89c231ff-55de-46d2-983b-418db68982c7 tempest-SnapshotsActionsTest-2007645282 None] Creating offline snapshot c9288e5d-a3d2-4dea-92b3-718eee020c3a of volume 939e143f-d62d-4096-afc4-9d73eaec9d87 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:49:34 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Attempting download of b71101b4-5e1f-4b78-90ce-ec8cda8c1237 ((None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}])) to volume f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2. {{(pid=87109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 05 03:49:34 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f6d648-5ff7-46f0-92f5-e07f70df67b1]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-89c231ff-55de-46d2-983b-418db68982c7 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:34 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0503720-6d9f-4e5b-8ac0-f2eeb6851be5]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_pokl1i9c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:35 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 Nov 05 03:49:35 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:35 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_pokl1i9c Nov 05 03:49:35 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:35 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-89c231ff-55de-46d2-983b-418db68982c7 tempest-SnapshotsActionsTest-2007645282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42" returned: 0 in 0.537s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-89c231ff-55de-46d2-983b-418db68982c7 tempest-SnapshotsActionsTest-2007645282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939e143f-d62d-4096-afc4-9d73eaec9d87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:49:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-89c231ff-55de-46d2-983b-418db68982c7 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.c9288e5d-a3d2-4dea-92b3-718eee020c3a 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:35 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_pokl1i9c" returned: 0 in 0.486s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:35 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.c9288e5d-a3d2-4dea-92b3-718eee020c3a 1G Nov 05 03:49:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_pokl1i9c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:35 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:35 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_pokl1i9c Nov 05 03:49:35 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:35 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_pokl1i9c" returned: 1 in 0.549s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_pokl1i9c' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:49:35 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:35 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b912e83b-f41a-4ea0-b9fb-ffc78343b1be]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_83tqlvuydevstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-89c231ff-55de-46d2-983b-418db68982c7 tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.c9288e5d-a3d2-4dea-92b3-718eee020c3a 1G" returned: 0 in 0.615s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-89c231ff-55de-46d2-983b-418db68982c7 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.c9288e5d-a3d2-4dea-92b3-718eee020c3a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:36 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.c9288e5d-a3d2-4dea-92b3-718eee020c3a Nov 05 03:49:36 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:36 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_83tqlvuydevstack@QuobyteHD Nov 05 03:49:36 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:36 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-89c231ff-55de-46d2-983b-418db68982c7 tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.c9288e5d-a3d2-4dea-92b3-718eee020c3a" returned: 0 in 0.341s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:36 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-89c231ff-55de-46d2-983b-418db68982c7 tempest-SnapshotsActionsTest-2007645282 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.c9288e5d-a3d2-4dea-92b3-718eee020c3a is being set with open permissions: ugo+rw Nov 05 03:49:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-89c231ff-55de-46d2-983b-418db68982c7 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.c9288e5d-a3d2-4dea-92b3-718eee020c3a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:36 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_83tqlvuydevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:36 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] b71101b4-5e1f-4b78-90ce-ec8cda8c1237 was qcow2, converting to qcow2 {{(pid=87109) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 05 03:49:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_83tqlvuydevstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:36 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.c9288e5d-a3d2-4dea-92b3-718eee020c3a Nov 05 03:49:36 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:36 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_83tqlvuydevstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2 Nov 05 03:49:36 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:36 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-89c231ff-55de-46d2-983b-418db68982c7 tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.c9288e5d-a3d2-4dea-92b3-718eee020c3a" returned: 0 in 0.275s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-89c231ff-55de-46d2-983b-418db68982c7 tempest-SnapshotsActionsTest-2007645282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:36 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-89c231ff-55de-46d2-983b-418db68982c7 tempest-SnapshotsActionsTest-2007645282 None] Create snapshot completed successfully Nov 05 03:49:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] Acquiring lock "cinder-c9288e5d-a3d2-4dea-92b3-718eee020c3a-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-c9288e5d-a3d2-4dea-92b3-718eee020c3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] Acquiring lock "cinder-quobyte-939e143f-d62d-4096-afc4-9d73eaec9d87" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-quobyte-939e143f-d62d-4096-afc4-9d73eaec9d87" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] Acquiring lock "cinder-quobyte-c9288e5d-a3d2-4dea-92b3-718eee020c3a" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-quobyte-c9288e5d-a3d2-4dea-92b3-718eee020c3a" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] Deleting offline snapshot c9288e5d-a3d2-4dea-92b3-718eee020c3a of volume 939e143f-d62d-4096-afc4-9d73eaec9d87 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:49:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] snapshot_file for this snap is: volume-939e143f-d62d-4096-afc4-9d73eaec9d87.c9288e5d-a3d2-4dea-92b3-718eee020c3a {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:49:37 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8703f7-2b64-4948-994a-d23d11d6dfbe]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.c9288e5d-a3d2-4dea-92b3-718eee020c3a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:37 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.c9288e5d-a3d2-4dea-92b3-718eee020c3a Nov 05 03:49:37 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.c9288e5d-a3d2-4dea-92b3-718eee020c3a" returned: 0 in 0.602s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:38 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939e143f-d62d-4096-afc4-9d73eaec9d87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:49:38 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:38 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2e7db5-fb9b-428b-9b75-3900e1ddf144]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:38 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 Nov 05 03:49:38 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:38 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42" returned: 0 in 0.609s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:38 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939e143f-d62d-4096-afc4-9d73eaec9d87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:49:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.c9288e5d-a3d2-4dea-92b3-718eee020c3a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:38 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.c9288e5d-a3d2-4dea-92b3-718eee020c3a Nov 05 03:49:38 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:39 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_83tqlvuydevstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2" returned: 0 in 2.925s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:39 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_83tqlvuydevstack@QuobyteHD, size 112.00 MB, duration 2.93 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2 {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:49:39 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Converted 112.00 MB image at 38.25 MB/s Nov 05 03:49:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:39 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2 1G Nov 05 03:49:39 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:39 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.c9288e5d-a3d2-4dea-92b3-718eee020c3a" returned: 0 in 0.679s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.c9288e5d-a3d2-4dea-92b3-718eee020c3a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:39 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.c9288e5d-a3d2-4dea-92b3-718eee020c3a Nov 05 03:49:39 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:39 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2 1G" returned: 0 in 0.420s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:39 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Downloaded image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 ((None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}])) to volume f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2 successfully. {{(pid=87109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 05 03:49:39 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Temporary image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 for user 4b2b54ffcf1d445983f8a6353e9498d4 is deleted. {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 05 03:49:39 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Marking volume f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2 as bootable. {{(pid=87109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 05 03:49:39 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Copying metadata from image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 to f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2. {{(pid=87109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 03:49:39 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Creating volume glance metadata for volume f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2 backed by image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 03:49:39 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.c9288e5d-a3d2-4dea-92b3-718eee020c3a" returned: 0 in 0.353s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:39 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-quobyte-c9288e5d-a3d2-4dea-92b3-718eee020c3a" released by "_delete_snapshot" :: held 2.516s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:39 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-quobyte-939e143f-d62d-4096-afc4-9d73eaec9d87" released by "delete_snapshot" :: held 2.579s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d35ac450-5807-4613-b108-1cbc8f6c2e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2', 'volume_size': 1, 'image_id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9a2a266d3247698576f415a1551384', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5acebae7-9006-4501-9974-b191b4b6a91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:40 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Volume volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2 (f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2): created successfully Nov 05 03:49:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5acebae7-9006-4501-9974-b191b4b6a91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Flow 'volume_create_manager' (846418c0-5a68-4c3e-b109-c9858332bc0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:40 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-768a0c78-2ad3-4084-b82a-caff53713afb tempest-VolumesGetTest-259433862 None] Created volume successfully. Nov 05 03:49:40 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] Created reservations ['693658a2-822b-47fb-ab13-73bb513b9cdf', '7d4ffab4-6e68-4252-a7bb-b582005ee1a8', '7e6bc4a7-ea05-4f30-b1a3-932bf524a34f', 'ab93e5ec-ddef-4f6c-a279-6e5b31d9d7cf'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:49:40 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] Delete snapshot completed successfully. Nov 05 03:49:40 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f754f52c-6114-4f65-90ba-e236c849ec14 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-c9288e5d-a3d2-4dea-92b3-718eee020c3a-delete_snapshot" released by "delete_snapshot" :: held 2.858s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-07f13864-bf2b-499a-8c94-82f44ee95c3e tempest-SnapshotsActionsTest-2007645282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-07f13864-bf2b-499a-8c94-82f44ee95c3e tempest-SnapshotsActionsTest-2007645282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:41 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-07f13864-bf2b-499a-8c94-82f44ee95c3e tempest-SnapshotsActionsTest-2007645282 None] Creating offline snapshot a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73 of volume 939e143f-d62d-4096-afc4-9d73eaec9d87 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:49:41 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[93516aef-be70-45cd-9916-d284b1e9e506]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-07f13864-bf2b-499a-8c94-82f44ee95c3e tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:41 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 Nov 05 03:49:41 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:41 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:41 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:49:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Flow 'volume_create_manager' (477c3274-9dce-413d-96ff-0473900d158b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da69935-f877-486d-9d30-33385b47ac8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-07f13864-bf2b-499a-8c94-82f44ee95c3e tempest-SnapshotsActionsTest-2007645282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42" returned: 0 in 0.807s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:41 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-07f13864-bf2b-499a-8c94-82f44ee95c3e tempest-SnapshotsActionsTest-2007645282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939e143f-d62d-4096-afc4-9d73eaec9d87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:49:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-07f13864-bf2b-499a-8c94-82f44ee95c3e tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da69935-f877-486d-9d30-33385b47ac8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-669870037',display_name='tempest-VolumesGetTest-Volume-1505737572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1af7fa-ecaa-40b3-a84b-594e27802e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bfe7486a4c4856b319e901309c9970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:42Z,use_quota=True,user_id='4b2b54ffcf1d445983f8a6353e9498d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:42 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73 1G Nov 05 03:49:42 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087b65aa-9a99-475f-8fb9-629322f0cd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087b65aa-9a99-475f-8fb9-629322f0cd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a96108-ff96-44e3-9db4-1b0dceb72e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5a96108-ff96-44e3-9db4-1b0dceb72e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b1af7fa-ecaa-40b3-a84b-594e27802e52', 'volume_name': 'volume-4b1af7fa-ecaa-40b3-a84b-594e27802e52', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7ee4bf-f695-4892-954f-22358da91b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b7ee4bf-f695-4892-954f-22358da91b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e39276-142b-4dfb-bb32-17d59a10ff14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:42 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Volume 4b1af7fa-ecaa-40b3-a84b-594e27802e52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b1af7fa-ecaa-40b3-a84b-594e27802e52', 'volume_size': 1} Nov 05 03:49:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:42 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-07f13864-bf2b-499a-8c94-82f44ee95c3e tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73 1G" returned: 0 in 0.874s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-07f13864-bf2b-499a-8c94-82f44ee95c3e tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:42 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73 Nov 05 03:49:42 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:43 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-07f13864-bf2b-499a-8c94-82f44ee95c3e tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73" returned: 0 in 0.356s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:43 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-07f13864-bf2b-499a-8c94-82f44ee95c3e tempest-SnapshotsActionsTest-2007645282 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73 is being set with open permissions: ugo+rw Nov 05 03:49:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-07f13864-bf2b-499a-8c94-82f44ee95c3e tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:43 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73 Nov 05 03:49:43 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:43 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-07f13864-bf2b-499a-8c94-82f44ee95c3e tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73" returned: 0 in 0.250s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-07f13864-bf2b-499a-8c94-82f44ee95c3e tempest-SnapshotsActionsTest-2007645282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.415s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.345s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:43 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-669870037',display_name='tempest-VolumesGetTest-Volume-1505737572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b1af7fa-ecaa-40b3-a84b-594e27802e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bfe7486a4c4856b319e901309c9970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:42Z,use_quota=True,user_id='4b2b54ffcf1d445983f8a6353e9498d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:49:43 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Creating volume 4b1af7fa-ecaa-40b3-a84b-594e27802e52 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:49:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:43 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:43 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:43 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:49:43 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:49:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4b1af7fa-ecaa-40b3-a84b-594e27802e52 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:43 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4b1af7fa-ecaa-40b3-a84b-594e27802e52 1073741824 Nov 05 03:49:43 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:43 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-07f13864-bf2b-499a-8c94-82f44ee95c3e tempest-SnapshotsActionsTest-2007645282 None] Create snapshot completed successfully Nov 05 03:49:43 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4b1af7fa-ecaa-40b3-a84b-594e27802e52 1073741824" returned: 0 in 0.462s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4b1af7fa-ecaa-40b3-a84b-594e27802e52 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:44 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4b1af7fa-ecaa-40b3-a84b-594e27802e52 Nov 05 03:49:44 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:44 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4b1af7fa-ecaa-40b3-a84b-594e27802e52" returned: 0 in 0.274s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:49:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e39276-142b-4dfb-bb32-17d59a10ff14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b1af7fa-ecaa-40b3-a84b-594e27802e52', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ce31c7-edce-48d5-898b-53d81e291587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:44 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Volume volume-4b1af7fa-ecaa-40b3-a84b-594e27802e52 (4b1af7fa-ecaa-40b3-a84b-594e27802e52): created successfully Nov 05 03:49:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ce31c7-edce-48d5-898b-53d81e291587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Flow 'volume_create_manager' (477c3274-9dce-413d-96ff-0473900d158b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] Acquiring lock "cinder-a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:44 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-bc243e86-b644-470b-ae83-ee6e157479d4 tempest-VolumesGetTest-259433862 None] Created volume successfully. Nov 05 03:49:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] Acquiring lock "cinder-quobyte-939e143f-d62d-4096-afc4-9d73eaec9d87" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-quobyte-939e143f-d62d-4096-afc4-9d73eaec9d87" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] Acquiring lock "cinder-quobyte-a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-quobyte-a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] Deleting offline snapshot a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73 of volume 939e143f-d62d-4096-afc4-9d73eaec9d87 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:49:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] snapshot_file for this snap is: volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:49:44 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89851c3-70de-41df-b94f-02ea3901b112]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:44 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73 Nov 05 03:49:44 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:44 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73" returned: 0 in 0.389s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939e143f-d62d-4096-afc4-9d73eaec9d87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:49:44 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b66c089-4edd-4a3d-807f-ba87bf5f0a35]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:44 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 Nov 05 03:49:44 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5e27e5fd-892d-4911-8cbd-9c1586919629 tempest-VolumesGetTest-259433862 None] Acquiring lock "cinder-4b1af7fa-ecaa-40b3-a84b-594e27802e52-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5e27e5fd-892d-4911-8cbd-9c1586919629 tempest-VolumesGetTest-259433862 None] Lock "cinder-4b1af7fa-ecaa-40b3-a84b-594e27802e52-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5e27e5fd-892d-4911-8cbd-9c1586919629 tempest-VolumesGetTest-259433862 None] Acquiring lock "cinder-quobyte-4b1af7fa-ecaa-40b3-a84b-594e27802e52" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5e27e5fd-892d-4911-8cbd-9c1586919629 tempest-VolumesGetTest-259433862 None] Lock "cinder-quobyte-4b1af7fa-ecaa-40b3-a84b-594e27802e52" acquired by "delete_volume" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:45 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[276e825c-a8e5-4f93-9ded-6d5e7d618c2d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5e27e5fd-892d-4911-8cbd-9c1586919629 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4b1af7fa-ecaa-40b3-a84b-594e27802e52 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:45 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42" returned: 0 in 0.455s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:45 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939e143f-d62d-4096-afc4-9d73eaec9d87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:49:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:45 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73 Nov 05 03:49:45 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:45 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4b1af7fa-ecaa-40b3-a84b-594e27802e52 Nov 05 03:49:45 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:45 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5e27e5fd-892d-4911-8cbd-9c1586919629 tempest-VolumesGetTest-259433862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4b1af7fa-ecaa-40b3-a84b-594e27802e52" returned: 0 in 0.484s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5e27e5fd-892d-4911-8cbd-9c1586919629 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4b1af7fa-ecaa-40b3-a84b-594e27802e52 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:45 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4b1af7fa-ecaa-40b3-a84b-594e27802e52 Nov 05 03:49:45 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:45 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73" returned: 0 in 0.513s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:45 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73 Nov 05 03:49:45 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Flow 'volume_create_manager' (8b638fd0-7de7-4feb-a8ce-a1bc5cc426c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a7daffd-0c0b-4901-8f54-1758d81ebdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:46 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a7daffd-0c0b-4901-8f54-1758d81ebdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-656912497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d96f5f-c2e4-460b-9ec6-e728353f47b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c62fcba293f4524ba3ecbb3b1006076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:46Z,use_quota=True,user_id='c67b98e3eb99410f81631f6ab964fd7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5334af62-e881-445d-a396-044b97532e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5334af62-e881-445d-a396-044b97532e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ec53ec-fa2f-4063-a1c6-48b42730c9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ec53ec-fa2f-4063-a1c6-48b42730c9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98d96f5f-c2e4-460b-9ec6-e728353f47b2', 'volume_name': 'volume-98d96f5f-c2e4-460b-9ec6-e728353f47b2', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd070b83-d957-403f-84dc-c074adfe5223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd070b83-d957-403f-84dc-c074adfe5223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b36217-ae48-442f-a989-3beb03b2d219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:46 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Volume 98d96f5f-c2e4-460b-9ec6-e728353f47b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98d96f5f-c2e4-460b-9ec6-e728353f47b2', 'volume_size': 1} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-656912497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d96f5f-c2e4-460b-9ec6-e728353f47b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c62fcba293f4524ba3ecbb3b1006076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:46Z,use_quota=True,user_id='c67b98e3eb99410f81631f6ab964fd7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Creating volume 98d96f5f-c2e4-460b-9ec6-e728353f47b2 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:49:46 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-98d96f5f-c2e4-460b-9ec6-e728353f47b2 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5e27e5fd-892d-4911-8cbd-9c1586919629 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4b1af7fa-ecaa-40b3-a84b-594e27802e52" returned: 0 in 0.401s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:46 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:46 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-98d96f5f-c2e4-460b-9ec6-e728353f47b2 1073741824 Nov 05 03:49:46 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73" returned: 0 in 0.339s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5e27e5fd-892d-4911-8cbd-9c1586919629 tempest-VolumesGetTest-259433862 None] Lock "cinder-quobyte-4b1af7fa-ecaa-40b3-a84b-594e27802e52" released by "delete_volume" :: held 0.972s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-quobyte-a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73" released by "_delete_snapshot" :: held 1.828s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-quobyte-939e143f-d62d-4096-afc4-9d73eaec9d87" released by "delete_snapshot" :: held 1.867s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-5e27e5fd-892d-4911-8cbd-9c1586919629 tempest-VolumesGetTest-259433862 None] Created reservations ['34c3e6f5-a745-4654-aef5-97fe810bf451', '315d295a-e128-4e84-ba4a-3e9fce9b15bc', '127aae06-417b-453a-8324-86c7810e6296', '9e1e1e94-9cb1-4220-aeef-0c8c86c0f229'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] Created reservations ['b89c4760-e4a4-46f1-ac43-df512b8a91f7', '0f835f5f-6592-47e1-b506-cca2f3735cfd', '963f3ba0-3b6b-4fae-b2e6-b0108a071f19', 'ec05b3c2-aad4-4502-859d-ff8d765da855'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5e27e5fd-892d-4911-8cbd-9c1586919629 tempest-VolumesGetTest-259433862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5e27e5fd-892d-4911-8cbd-9c1586919629 tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5e27e5fd-892d-4911-8cbd-9c1586919629 tempest-VolumesGetTest-259433862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5e27e5fd-892d-4911-8cbd-9c1586919629 tempest-VolumesGetTest-259433862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5e27e5fd-892d-4911-8cbd-9c1586919629 tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5e27e5fd-892d-4911-8cbd-9c1586919629 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:46 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:49:46 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:46 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] Delete snapshot completed successfully. Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ec5ead2c-2801-4981-84bd-6ac02d8ecc15 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-a0ecdb6a-74ce-4a00-b8bd-466cae0c9a73-delete_snapshot" released by "delete_snapshot" :: held 2.125s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:46 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5e27e5fd-892d-4911-8cbd-9c1586919629 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.371s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-5e27e5fd-892d-4911-8cbd-9c1586919629 tempest-VolumesGetTest-259433862 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:49:46 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5e27e5fd-892d-4911-8cbd-9c1586919629 tempest-VolumesGetTest-259433862 None] Deleted volume successfully. Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5e27e5fd-892d-4911-8cbd-9c1586919629 tempest-VolumesGetTest-259433862 None] Lock "cinder-4b1af7fa-ecaa-40b3-a84b-594e27802e52-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:46 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-98d96f5f-c2e4-460b-9ec6-e728353f47b2 1073741824" returned: 0 in 0.668s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-98d96f5f-c2e4-460b-9ec6-e728353f47b2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:46 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-98d96f5f-c2e4-460b-9ec6-e728353f47b2 Nov 05 03:49:46 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b7deae57-69ca-41c8-b2fa-dde4e5030d57 tempest-SnapshotsActionsTest-2007645282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:47 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-98d96f5f-c2e4-460b-9ec6-e728353f47b2" returned: 0 in 0.285s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:49:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b7deae57-69ca-41c8-b2fa-dde4e5030d57 tempest-SnapshotsActionsTest-2007645282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.218s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b36217-ae48-442f-a989-3beb03b2d219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98d96f5f-c2e4-460b-9ec6-e728353f47b2', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0cf7d94-cac8-4a6a-a445-46ed8b1cd608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-b7deae57-69ca-41c8-b2fa-dde4e5030d57 tempest-SnapshotsActionsTest-2007645282 None] Creating offline snapshot a04cabc3-69d9-4b9a-af66-98ec0d078fdb of volume 939e143f-d62d-4096-afc4-9d73eaec9d87 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:49:47 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Volume volume-98d96f5f-c2e4-460b-9ec6-e728353f47b2 (98d96f5f-c2e4-460b-9ec6-e728353f47b2): created successfully Nov 05 03:49:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0cf7d94-cac8-4a6a-a445-46ed8b1cd608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Flow 'volume_create_manager' (8b638fd0-7de7-4feb-a8ce-a1bc5cc426c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:47 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[826e927e-05a7-4261-8b82-f7e5c9badeea]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b7deae57-69ca-41c8-b2fa-dde4e5030d57 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:47 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-05e4dd80-a9d9-42ad-aa06-1c4b60333afb tempest-AttachVolumeNegativeTest-671600555 None] Created volume successfully. Nov 05 03:49:47 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 Nov 05 03:49:47 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bbdeba0f-4ff1-4ece-b1b8-b1cb35929603 tempest-VolumesGetTest-259433862 None] Acquiring lock "cinder-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bbdeba0f-4ff1-4ece-b1b8-b1cb35929603 tempest-VolumesGetTest-259433862 None] Lock "cinder-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bbdeba0f-4ff1-4ece-b1b8-b1cb35929603 tempest-VolumesGetTest-259433862 None] Acquiring lock "cinder-quobyte-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bbdeba0f-4ff1-4ece-b1b8-b1cb35929603 tempest-VolumesGetTest-259433862 None] Lock "cinder-quobyte-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2" acquired by "delete_volume" :: waited 0.018s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:47 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee649376-66e0-44b1-ac16-e40779020339]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bbdeba0f-4ff1-4ece-b1b8-b1cb35929603 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:47 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b7deae57-69ca-41c8-b2fa-dde4e5030d57 tempest-SnapshotsActionsTest-2007645282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42" returned: 0 in 0.447s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-b7deae57-69ca-41c8-b2fa-dde4e5030d57 tempest-SnapshotsActionsTest-2007645282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939e143f-d62d-4096-afc4-9d73eaec9d87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:49:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b7deae57-69ca-41c8-b2fa-dde4e5030d57 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a04cabc3-69d9-4b9a-af66-98ec0d078fdb 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:47 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2 Nov 05 03:49:47 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:47 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a04cabc3-69d9-4b9a-af66-98ec0d078fdb 1G Nov 05 03:49:47 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:48 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bbdeba0f-4ff1-4ece-b1b8-b1cb35929603 tempest-VolumesGetTest-259433862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2" returned: 0 in 0.450s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bbdeba0f-4ff1-4ece-b1b8-b1cb35929603 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:48 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2 Nov 05 03:49:48 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:48 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b7deae57-69ca-41c8-b2fa-dde4e5030d57 tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a04cabc3-69d9-4b9a-af66-98ec0d078fdb 1G" returned: 0 in 0.599s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b7deae57-69ca-41c8-b2fa-dde4e5030d57 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a04cabc3-69d9-4b9a-af66-98ec0d078fdb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:48 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a04cabc3-69d9-4b9a-af66-98ec0d078fdb Nov 05 03:49:48 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:48 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bbdeba0f-4ff1-4ece-b1b8-b1cb35929603 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2" returned: 0 in 0.310s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:48 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bbdeba0f-4ff1-4ece-b1b8-b1cb35929603 tempest-VolumesGetTest-259433862 None] Lock "cinder-quobyte-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2" released by "delete_volume" :: held 0.815s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:48 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-bbdeba0f-4ff1-4ece-b1b8-b1cb35929603 tempest-VolumesGetTest-259433862 None] Created reservations ['f47a356c-9cc5-4b8b-b26c-d5209844607b', 'af20fdee-3014-4ddc-b971-79c0f60add0b', '74f14555-e9dc-4d3e-b0b6-b04e91840cc9', '5519891b-da7d-42d4-83b1-57e1f747e956'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:49:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bbdeba0f-4ff1-4ece-b1b8-b1cb35929603 tempest-VolumesGetTest-259433862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bbdeba0f-4ff1-4ece-b1b8-b1cb35929603 tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-bbdeba0f-4ff1-4ece-b1b8-b1cb35929603 tempest-VolumesGetTest-259433862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-bbdeba0f-4ff1-4ece-b1b8-b1cb35929603 tempest-VolumesGetTest-259433862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bbdeba0f-4ff1-4ece-b1b8-b1cb35929603 tempest-VolumesGetTest-259433862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bbdeba0f-4ff1-4ece-b1b8-b1cb35929603 tempest-VolumesGetTest-259433862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:48 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:49:48 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:48 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b7deae57-69ca-41c8-b2fa-dde4e5030d57 tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a04cabc3-69d9-4b9a-af66-98ec0d078fdb" returned: 0 in 0.483s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:48 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-b7deae57-69ca-41c8-b2fa-dde4e5030d57 tempest-SnapshotsActionsTest-2007645282 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a04cabc3-69d9-4b9a-af66-98ec0d078fdb is being set with open permissions: ugo+rw Nov 05 03:49:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b7deae57-69ca-41c8-b2fa-dde4e5030d57 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a04cabc3-69d9-4b9a-af66-98ec0d078fdb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:48 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a04cabc3-69d9-4b9a-af66-98ec0d078fdb Nov 05 03:49:48 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:48 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bbdeba0f-4ff1-4ece-b1b8-b1cb35929603 tempest-VolumesGetTest-259433862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.371s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:48 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-bbdeba0f-4ff1-4ece-b1b8-b1cb35929603 tempest-VolumesGetTest-259433862 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:49:49 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-bbdeba0f-4ff1-4ece-b1b8-b1cb35929603 tempest-VolumesGetTest-259433862 None] Deleted volume successfully. Nov 05 03:49:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-48463da4-0f88-446d-8fb8-6f1da4cb48bf req-a50ab60d-7a03-4c1c-ab36-034ce8e14772 tempest-AttachVolumeNegativeTest-671600555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bbdeba0f-4ff1-4ece-b1b8-b1cb35929603 tempest-VolumesGetTest-259433862 None] Lock "cinder-f2b663d0-ac8f-4ae9-b0b6-d37191ab93e2-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:49 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b7deae57-69ca-41c8-b2fa-dde4e5030d57 tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a04cabc3-69d9-4b9a-af66-98ec0d078fdb" returned: 0 in 0.372s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b7deae57-69ca-41c8-b2fa-dde4e5030d57 tempest-SnapshotsActionsTest-2007645282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.049s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-48463da4-0f88-446d-8fb8-6f1da4cb48bf req-a50ab60d-7a03-4c1c-ab36-034ce8e14772 tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.212s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-48463da4-0f88-446d-8fb8-6f1da4cb48bf req-a50ab60d-7a03-4c1c-ab36-034ce8e14772 tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:49 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b7deae57-69ca-41c8-b2fa-dde4e5030d57 tempest-SnapshotsActionsTest-2007645282 None] Create snapshot completed successfully Nov 05 03:49:49 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-48463da4-0f88-446d-8fb8-6f1da4cb48bf req-a50ab60d-7a03-4c1c-ab36-034ce8e14772 tempest-AttachVolumeNegativeTest-671600555 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-98d96f5f-c2e4-460b-9ec6-e728353f47b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd837171a-a643-4cd5-98d7-beda2188a93f', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:49:49 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-48463da4-0f88-446d-8fb8-6f1da4cb48bf req-a50ab60d-7a03-4c1c-ab36-034ce8e14772 tempest-AttachVolumeNegativeTest-671600555 None] attachment_update completed successfully. Nov 05 03:49:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] Acquiring lock "cinder-a04cabc3-69d9-4b9a-af66-98ec0d078fdb-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-a04cabc3-69d9-4b9a-af66-98ec0d078fdb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] Acquiring lock "cinder-quobyte-939e143f-d62d-4096-afc4-9d73eaec9d87" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-quobyte-939e143f-d62d-4096-afc4-9d73eaec9d87" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] Acquiring lock "cinder-quobyte-a04cabc3-69d9-4b9a-af66-98ec0d078fdb" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-quobyte-a04cabc3-69d9-4b9a-af66-98ec0d078fdb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] Deleting offline snapshot a04cabc3-69d9-4b9a-af66-98ec0d078fdb of volume 939e143f-d62d-4096-afc4-9d73eaec9d87 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:49:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] snapshot_file for this snap is: volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a04cabc3-69d9-4b9a-af66-98ec0d078fdb {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:49:50 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25eec28-67e2-436b-9029-2a94ea430948]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a04cabc3-69d9-4b9a-af66-98ec0d078fdb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:50 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a04cabc3-69d9-4b9a-af66-98ec0d078fdb Nov 05 03:49:50 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:50 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a04cabc3-69d9-4b9a-af66-98ec0d078fdb" returned: 0 in 0.495s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939e143f-d62d-4096-afc4-9d73eaec9d87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:49:51 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eff0eed-9471-4f32-ae70-bd7099c3d22d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:51 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 Nov 05 03:49:51 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:51 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42" returned: 0 in 0.515s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939e143f-d62d-4096-afc4-9d73eaec9d87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:49:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a04cabc3-69d9-4b9a-af66-98ec0d078fdb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:51 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a04cabc3-69d9-4b9a-af66-98ec0d078fdb Nov 05 03:49:51 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-aa03887a-c137-4217-a5b5-eb4b7ecc2852 tempest-VolumesNegativeTest-226258957 None] Acquiring lock "cinder-9cd7498d-b527-4ee6-98f0-ca420c2dc970-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:52 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-aa03887a-c137-4217-a5b5-eb4b7ecc2852 tempest-VolumesNegativeTest-226258957 None] Lock "cinder-9cd7498d-b527-4ee6-98f0-ca420c2dc970-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a04cabc3-69d9-4b9a-af66-98ec0d078fdb" returned: 0 in 0.526s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a04cabc3-69d9-4b9a-af66-98ec0d078fdb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:52 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-91e4b5c1-0b31-4d9b-ad9f-5c7499949188 req-254df61c-0f13-42f5-9c9f-72e4800920f6 tempest-AttachVolumeNegativeTest-671600555 None] Terminate volume connection completed successfully. Nov 05 03:49:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-91e4b5c1-0b31-4d9b-ad9f-5c7499949188 req-254df61c-0f13-42f5-9c9f-72e4800920f6 tempest-AttachVolumeNegativeTest-671600555 None] Deleting attachment d837171a-a643-4cd5-98d7-beda2188a93f. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:49:52 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a04cabc3-69d9-4b9a-af66-98ec0d078fdb Nov 05 03:49:52 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-aa03887a-c137-4217-a5b5-eb4b7ecc2852 tempest-VolumesNegativeTest-226258957 None] Acquiring lock "cinder-quobyte-9cd7498d-b527-4ee6-98f0-ca420c2dc970" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-aa03887a-c137-4217-a5b5-eb4b7ecc2852 tempest-VolumesNegativeTest-226258957 None] Lock "cinder-quobyte-9cd7498d-b527-4ee6-98f0-ca420c2dc970" acquired by "delete_volume" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:52 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb513ab-7480-4451-a784-8adb810a973c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aa03887a-c137-4217-a5b5-eb4b7ecc2852 tempest-VolumesNegativeTest-226258957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9cd7498d-b527-4ee6-98f0-ca420c2dc970 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:52 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9cd7498d-b527-4ee6-98f0-ca420c2dc970 Nov 05 03:49:52 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:52 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a04cabc3-69d9-4b9a-af66-98ec0d078fdb" returned: 0 in 0.300s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-quobyte-a04cabc3-69d9-4b9a-af66-98ec0d078fdb" released by "_delete_snapshot" :: held 1.987s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-quobyte-939e143f-d62d-4096-afc4-9d73eaec9d87" released by "delete_snapshot" :: held 2.013s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:52 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] Created reservations ['c67570fe-64ea-4d4a-81dc-36524a11d6af', '23830e5c-5ec9-4d66-b848-eba3c8372e02', '53f9aa43-cbb2-45b7-82bf-16934707b9ea', 'e8ddbfe5-7cf5-4a3e-a805-37382fdeb95f'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:49:52 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] Delete snapshot completed successfully. Nov 05 03:49:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-af53f9bb-b260-4495-b816-a0498ab5f7c7 tempest-SnapshotsActionsTest-1940264199 None] Lock "cinder-a04cabc3-69d9-4b9a-af66-98ec0d078fdb-delete_snapshot" released by "delete_snapshot" :: held 2.185s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:52 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aa03887a-c137-4217-a5b5-eb4b7ecc2852 tempest-VolumesNegativeTest-226258957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9cd7498d-b527-4ee6-98f0-ca420c2dc970" returned: 0 in 0.427s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aa03887a-c137-4217-a5b5-eb4b7ecc2852 tempest-VolumesNegativeTest-226258957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9cd7498d-b527-4ee6-98f0-ca420c2dc970 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:52 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9cd7498d-b527-4ee6-98f0-ca420c2dc970 Nov 05 03:49:52 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:52 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aa03887a-c137-4217-a5b5-eb4b7ecc2852 tempest-VolumesNegativeTest-226258957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9cd7498d-b527-4ee6-98f0-ca420c2dc970" returned: 0 in 0.356s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-aa03887a-c137-4217-a5b5-eb4b7ecc2852 tempest-VolumesNegativeTest-226258957 None] Lock "cinder-quobyte-9cd7498d-b527-4ee6-98f0-ca420c2dc970" released by "delete_volume" :: held 0.863s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:53 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-aa03887a-c137-4217-a5b5-eb4b7ecc2852 tempest-VolumesNegativeTest-226258957 None] Created reservations ['8b923b07-1b90-4f07-bde1-281dc66a05be', 'f35aa190-417b-4488-be66-c8ecf61db246', 'd66e1f10-e0a5-40bb-826e-344fb6c72ab3', '93bd53e1-6d4c-493c-993a-e4aa5f4dd2c2'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:49:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aa03887a-c137-4217-a5b5-eb4b7ecc2852 tempest-VolumesNegativeTest-226258957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aa03887a-c137-4217-a5b5-eb4b7ecc2852 tempest-VolumesNegativeTest-226258957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-aa03887a-c137-4217-a5b5-eb4b7ecc2852 tempest-VolumesNegativeTest-226258957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-aa03887a-c137-4217-a5b5-eb4b7ecc2852 tempest-VolumesNegativeTest-226258957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aa03887a-c137-4217-a5b5-eb4b7ecc2852 tempest-VolumesNegativeTest-226258957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aa03887a-c137-4217-a5b5-eb4b7ecc2852 tempest-VolumesNegativeTest-226258957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:53 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:49:53 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:53 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:49:53 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Flow 'volume_create_manager' (fc1e8020-a10c-4f90-8375-5c320b01410e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68ff82a-2726-4fa9-b3bb-de3fde270444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aa03887a-c137-4217-a5b5-eb4b7ecc2852 tempest-VolumesNegativeTest-226258957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.662s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:53 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-aa03887a-c137-4217-a5b5-eb4b7ecc2852 tempest-VolumesNegativeTest-226258957 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:49:53 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-aa03887a-c137-4217-a5b5-eb4b7ecc2852 tempest-VolumesNegativeTest-226258957 None] Deleted volume successfully. Nov 05 03:49:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68ff82a-2726-4fa9-b3bb-de3fde270444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1547659280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f57e4e-f71f-42ea-849d-196389e18ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa80981b2d2645779666dce3bac0a262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:54Z,use_quota=True,user_id='cd58c17b8321439d9282110d4d467296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af172009-7282-4a67-a761-92bee3256c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af172009-7282-4a67-a761-92bee3256c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c301bfb1-964f-441a-9565-5e049760b234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c301bfb1-964f-441a-9565-5e049760b234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6f57e4e-f71f-42ea-849d-196389e18ed2', 'volume_name': 'volume-b6f57e4e-f71f-42ea-849d-196389e18ed2', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e9f73c-0216-4051-9a45-94be02acf2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e9f73c-0216-4051-9a45-94be02acf2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7738dcef-5e5c-4c7d-abda-1310c552926f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:54 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Volume b6f57e4e-f71f-42ea-849d-196389e18ed2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6f57e4e-f71f-42ea-849d-196389e18ed2', 'volume_size': 1} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1547659280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f57e4e-f71f-42ea-849d-196389e18ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa80981b2d2645779666dce3bac0a262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:49:54Z,use_quota=True,user_id='cd58c17b8321439d9282110d4d467296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Creating volume b6f57e4e-f71f-42ea-849d-196389e18ed2 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:49:54 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-aa03887a-c137-4217-a5b5-eb4b7ecc2852 tempest-VolumesNegativeTest-226258957 None] Lock "cinder-9cd7498d-b527-4ee6-98f0-ca420c2dc970-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:54 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2 1073741824 Nov 05 03:49:54 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:54 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2 1073741824" returned: 0 in 0.721s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:54 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2 Nov 05 03:49:54 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] Acquiring lock "cinder-a3b88ad7-9e27-4e4b-aa56-a89516370b42-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] Lock "cinder-a3b88ad7-9e27-4e4b-aa56-a89516370b42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] Acquiring lock "cinder-quobyte-939e143f-d62d-4096-afc4-9d73eaec9d87" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] Lock "cinder-quobyte-939e143f-d62d-4096-afc4-9d73eaec9d87" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] Acquiring lock "cinder-quobyte-a3b88ad7-9e27-4e4b-aa56-a89516370b42" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] Lock "cinder-quobyte-a3b88ad7-9e27-4e4b-aa56-a89516370b42" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] Deleting offline snapshot a3b88ad7-9e27-4e4b-aa56-a89516370b42 of volume 939e143f-d62d-4096-afc4-9d73eaec9d87 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:49:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] snapshot_file for this snap is: volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:49:55 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafcfeb1-e88b-40a8-b0f8-ee4b0b69b508]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:55 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2" returned: 0 in 0.368s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:49:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:55 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 Nov 05 03:49:55 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7738dcef-5e5c-4c7d-abda-1310c552926f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6f57e4e-f71f-42ea-849d-196389e18ed2', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b695fb-41d9-4ca3-8eb4-3556a03e7d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:49:55 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Volume volume-b6f57e4e-f71f-42ea-849d-196389e18ed2 (b6f57e4e-f71f-42ea-849d-196389e18ed2): created successfully Nov 05 03:49:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96b695fb-41d9-4ca3-8eb4-3556a03e7d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:49:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Flow 'volume_create_manager' (fc1e8020-a10c-4f90-8375-5c320b01410e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:49:55 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-7c580e3a-7eeb-4f26-8a68-5f79ebc86ae9 tempest-VolumesSnapshotListTestJSON-447370403 None] Created volume successfully. Nov 05 03:49:55 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42" returned: 0 in 0.516s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-939e143f-d62d-4096-afc4-9d73eaec9d87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:49:55 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6de280-29fb-4579-9c00-2ddfcdb09bd2]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:55 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87 Nov 05 03:49:55 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:56 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87" returned: 0 in 0.487s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:56 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 Nov 05 03:49:56 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b4aa0731-e710-4553-b2fa-4bf828fdae01 tempest-VolumesSnapshotListTestJSON-447370403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b4aa0731-e710-4553-b2fa-4bf828fdae01 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-b4aa0731-e710-4553-b2fa-4bf828fdae01 tempest-VolumesSnapshotListTestJSON-447370403 None] Creating offline snapshot 8701a542-4110-4db9-83c3-7eaf357529c3 of volume b6f57e4e-f71f-42ea-849d-196389e18ed2 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:49:56 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7430e43c-4cad-4239-8cfd-d8b997b1d54d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b4aa0731-e710-4553-b2fa-4bf828fdae01 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:56 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2 Nov 05 03:49:56 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:56 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42" returned: 0 in 0.430s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:56 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42 Nov 05 03:49:56 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:56 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b4aa0731-e710-4553-b2fa-4bf828fdae01 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2" returned: 0 in 0.434s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b4aa0731-e710-4553-b2fa-4bf828fdae01 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:56 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 1G Nov 05 03:49:56 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:56 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87.a3b88ad7-9e27-4e4b-aa56-a89516370b42" returned: 0 in 0.343s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] Lock "cinder-quobyte-a3b88ad7-9e27-4e4b-aa56-a89516370b42" released by "_delete_snapshot" :: held 1.951s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] Lock "cinder-quobyte-939e143f-d62d-4096-afc4-9d73eaec9d87" released by "delete_snapshot" :: held 1.992s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:57 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] Created reservations ['3ed698e8-e76d-4710-962c-d3c9453d2fca', 'b20d989b-ee68-4ca0-8a1c-70f2e8d4e21b', 'c89eb4a6-6c24-4b08-89ad-63e81716845b', '071e16ab-77ea-4753-af36-054ac24655d0'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:49:57 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] Delete snapshot completed successfully. Nov 05 03:49:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d610314d-41e5-42a2-beee-4b379f4b2f00 tempest-SnapshotsActionsTest-2007645282 None] Lock "cinder-a3b88ad7-9e27-4e4b-aa56-a89516370b42-delete_snapshot" released by "delete_snapshot" :: held 2.302s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:57 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b4aa0731-e710-4553-b2fa-4bf828fdae01 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 1G" returned: 0 in 0.634s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b4aa0731-e710-4553-b2fa-4bf828fdae01 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f57e4e-f71f-42ea-849d-196389e18ed2 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:57 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f57e4e-f71f-42ea-849d-196389e18ed2 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 Nov 05 03:49:57 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:57 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b4aa0731-e710-4553-b2fa-4bf828fdae01 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f57e4e-f71f-42ea-849d-196389e18ed2 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3" returned: 0 in 0.358s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:57 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-b4aa0731-e710-4553-b2fa-4bf828fdae01 tempest-VolumesSnapshotListTestJSON-447370403 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 is being set with open permissions: ugo+rw Nov 05 03:49:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b4aa0731-e710-4553-b2fa-4bf828fdae01 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:57 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 Nov 05 03:49:57 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:58 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b4aa0731-e710-4553-b2fa-4bf828fdae01 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3" returned: 0 in 0.291s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b4aa0731-e710-4553-b2fa-4bf828fdae01 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:58 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.info Nov 05 03:49:58 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3f973202-7bca-440b-8265-c93c2235003a tempest-SnapshotsActionsTest-2007645282 None] Acquiring lock "cinder-939e143f-d62d-4096-afc4-9d73eaec9d87-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3f973202-7bca-440b-8265-c93c2235003a tempest-SnapshotsActionsTest-2007645282 None] Lock "cinder-939e143f-d62d-4096-afc4-9d73eaec9d87-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3f973202-7bca-440b-8265-c93c2235003a tempest-SnapshotsActionsTest-2007645282 None] Acquiring lock "cinder-quobyte-939e143f-d62d-4096-afc4-9d73eaec9d87" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3f973202-7bca-440b-8265-c93c2235003a tempest-SnapshotsActionsTest-2007645282 None] Lock "cinder-quobyte-939e143f-d62d-4096-afc4-9d73eaec9d87" acquired by "delete_volume" :: waited 0.043s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:49:58 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:49:58 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:58 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b4aa0731-e710-4553-b2fa-4bf828fdae01 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.info" returned: 0 in 0.450s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:58 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-b4aa0731-e710-4553-b2fa-4bf828fdae01 tempest-VolumesSnapshotListTestJSON-447370403 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.info is being set with open permissions: ugo+rw Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b4aa0731-e710-4553-b2fa-4bf828fdae01 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1dfa1d-e9fc-4b82-b9ea-c4b4937c8179]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3f973202-7bca-440b-8265-c93c2235003a tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:58 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.info Nov 05 03:49:58 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:58 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87 Nov 05 03:49:58 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:58 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.411s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:49:58 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b4aa0731-e710-4553-b2fa-4bf828fdae01 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.info" returned: 0 in 0.334s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b4aa0731-e710-4553-b2fa-4bf828fdae01 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.633s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 28 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:49:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:49:58 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b4aa0731-e710-4553-b2fa-4bf828fdae01 tempest-VolumesSnapshotListTestJSON-447370403 None] Create snapshot completed successfully Nov 05 03:49:59 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3f973202-7bca-440b-8265-c93c2235003a tempest-SnapshotsActionsTest-2007645282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87" returned: 0 in 0.569s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3f973202-7bca-440b-8265-c93c2235003a tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:59 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87 Nov 05 03:49:59 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:59 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Nov 05 03:49:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3f973202-7bca-440b-8265-c93c2235003a tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-939e143f-d62d-4096-afc4-9d73eaec9d87" returned: 0 in 0.323s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:49:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3f973202-7bca-440b-8265-c93c2235003a tempest-SnapshotsActionsTest-2007645282 None] Lock "cinder-quobyte-939e143f-d62d-4096-afc4-9d73eaec9d87" released by "delete_volume" :: held 1.008s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:49:59 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-3f973202-7bca-440b-8265-c93c2235003a tempest-SnapshotsActionsTest-2007645282 None] Created reservations ['b57444a1-a15d-4aae-b3c1-d15e2271b779', '80ca51e2-484d-4e7e-aaa6-81ae0b7fbba0', 'fee8fa43-3669-4886-a077-81b0b7fd18e2', '9284a34b-8a80-47df-b69c-3107a8c88678'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:49:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3f973202-7bca-440b-8265-c93c2235003a tempest-SnapshotsActionsTest-2007645282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3f973202-7bca-440b-8265-c93c2235003a tempest-SnapshotsActionsTest-2007645282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:59 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3f973202-7bca-440b-8265-c93c2235003a tempest-SnapshotsActionsTest-2007645282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:49:59 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3f973202-7bca-440b-8265-c93c2235003a tempest-SnapshotsActionsTest-2007645282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:49:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3f973202-7bca-440b-8265-c93c2235003a tempest-SnapshotsActionsTest-2007645282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:49:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3f973202-7bca-440b-8265-c93c2235003a tempest-SnapshotsActionsTest-2007645282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:49:59 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:49:59 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:49:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-90018999-3c30-42ef-8cf2-1857ae3805ca tempest-VolumesSnapshotListTestJSON-447370403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:49:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-90018999-3c30-42ef-8cf2-1857ae3805ca tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:49:59 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-90018999-3c30-42ef-8cf2-1857ae3805ca tempest-VolumesSnapshotListTestJSON-447370403 None] Creating offline snapshot a64d1b88-63f6-4ce8-9a47-778d77db385c of volume b6f57e4e-f71f-42ea-849d-196389e18ed2 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:49:59 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[59030ffb-88d2-4357-9a1d-6dd30fa8f84c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:49:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90018999-3c30-42ef-8cf2-1857ae3805ca tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:00 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3f973202-7bca-440b-8265-c93c2235003a tempest-SnapshotsActionsTest-2007645282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.365s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:00 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-3f973202-7bca-440b-8265-c93c2235003a tempest-SnapshotsActionsTest-2007645282 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:00 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-3f973202-7bca-440b-8265-c93c2235003a tempest-SnapshotsActionsTest-2007645282 None] Deleted volume successfully. Nov 05 03:50:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3f973202-7bca-440b-8265-c93c2235003a tempest-SnapshotsActionsTest-2007645282 None] Lock "cinder-939e143f-d62d-4096-afc4-9d73eaec9d87-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:00 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 Nov 05 03:50:00 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:00 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90018999-3c30-42ef-8cf2-1857ae3805ca tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3" returned: 0 in 0.465s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-90018999-3c30-42ef-8cf2-1857ae3805ca tempest-VolumesSnapshotListTestJSON-447370403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6f57e4e-f71f-42ea-849d-196389e18ed2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:50:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90018999-3c30-42ef-8cf2-1857ae3805ca tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:00 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c 1G Nov 05 03:50:00 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:01 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90018999-3c30-42ef-8cf2-1857ae3805ca tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c 1G" returned: 0 in 0.657s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90018999-3c30-42ef-8cf2-1857ae3805ca tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:01 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c Nov 05 03:50:01 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:01 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90018999-3c30-42ef-8cf2-1857ae3805ca tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c" returned: 0 in 0.362s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:01 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-90018999-3c30-42ef-8cf2-1857ae3805ca tempest-VolumesSnapshotListTestJSON-447370403 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c is being set with open permissions: ugo+rw Nov 05 03:50:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90018999-3c30-42ef-8cf2-1857ae3805ca tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:01 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c Nov 05 03:50:01 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:01 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90018999-3c30-42ef-8cf2-1857ae3805ca tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c" returned: 0 in 0.326s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-90018999-3c30-42ef-8cf2-1857ae3805ca tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.994s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:01 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-90018999-3c30-42ef-8cf2-1857ae3805ca tempest-VolumesSnapshotListTestJSON-447370403 None] Create snapshot completed successfully Nov 05 03:50:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-55dc19bd-a4c5-4d32-8299-915b0c4448d3 tempest-VolumesSnapshotListTestJSON-447370403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-55dc19bd-a4c5-4d32-8299-915b0c4448d3 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-55dc19bd-a4c5-4d32-8299-915b0c4448d3 tempest-VolumesSnapshotListTestJSON-447370403 None] Creating offline snapshot 01f55691-ed89-4d55-8faa-2e1007cfef8c of volume b6f57e4e-f71f-42ea-849d-196389e18ed2 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:50:03 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f431252-7cb4-4fb9-8497-5f0f7284a36b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-55dc19bd-a4c5-4d32-8299-915b0c4448d3 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:03 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c Nov 05 03:50:03 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:03 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-55dc19bd-a4c5-4d32-8299-915b0c4448d3 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c" returned: 0 in 0.434s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-55dc19bd-a4c5-4d32-8299-915b0c4448d3 tempest-VolumesSnapshotListTestJSON-447370403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6f57e4e-f71f-42ea-849d-196389e18ed2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:50:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-55dc19bd-a4c5-4d32-8299-915b0c4448d3 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.01f55691-ed89-4d55-8faa-2e1007cfef8c 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:04 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.01f55691-ed89-4d55-8faa-2e1007cfef8c 1G Nov 05 03:50:04 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:04 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-55dc19bd-a4c5-4d32-8299-915b0c4448d3 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.01f55691-ed89-4d55-8faa-2e1007cfef8c 1G" returned: 0 in 0.682s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-55dc19bd-a4c5-4d32-8299-915b0c4448d3 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.01f55691-ed89-4d55-8faa-2e1007cfef8c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:04 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.01f55691-ed89-4d55-8faa-2e1007cfef8c Nov 05 03:50:04 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:05 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-55dc19bd-a4c5-4d32-8299-915b0c4448d3 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.01f55691-ed89-4d55-8faa-2e1007cfef8c" returned: 0 in 0.426s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:05 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-55dc19bd-a4c5-4d32-8299-915b0c4448d3 tempest-VolumesSnapshotListTestJSON-447370403 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.01f55691-ed89-4d55-8faa-2e1007cfef8c is being set with open permissions: ugo+rw Nov 05 03:50:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-55dc19bd-a4c5-4d32-8299-915b0c4448d3 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.01f55691-ed89-4d55-8faa-2e1007cfef8c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:05 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.01f55691-ed89-4d55-8faa-2e1007cfef8c Nov 05 03:50:05 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:05 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-55dc19bd-a4c5-4d32-8299-915b0c4448d3 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.01f55691-ed89-4d55-8faa-2e1007cfef8c" returned: 0 in 0.361s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:05 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=132,cinder:INSERT=35,cinder:UPDATE=147,cinder:DELETE=10 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:50:05 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=131,cinder:UPDATE=130,cinder:INSERT=46,cinder:DELETE=15 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:50:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-55dc19bd-a4c5-4d32-8299-915b0c4448d3 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.090s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:05 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-55dc19bd-a4c5-4d32-8299-915b0c4448d3 tempest-VolumesSnapshotListTestJSON-447370403 None] Create snapshot completed successfully Nov 05 03:50:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] Acquiring lock "cinder-01f55691-ed89-4d55-8faa-2e1007cfef8c-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-01f55691-ed89-4d55-8faa-2e1007cfef8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] Acquiring lock "cinder-quobyte-b6f57e4e-f71f-42ea-849d-196389e18ed2" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-quobyte-b6f57e4e-f71f-42ea-849d-196389e18ed2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] Acquiring lock "cinder-quobyte-01f55691-ed89-4d55-8faa-2e1007cfef8c" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-quobyte-01f55691-ed89-4d55-8faa-2e1007cfef8c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:08 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] Deleting offline snapshot 01f55691-ed89-4d55-8faa-2e1007cfef8c of volume b6f57e4e-f71f-42ea-849d-196389e18ed2 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:50:08 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] snapshot_file for this snap is: volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.01f55691-ed89-4d55-8faa-2e1007cfef8c {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:50:08 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[862872ee-3ad9-4467-80f0-3ade3f0ff9d6]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.01f55691-ed89-4d55-8faa-2e1007cfef8c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:08 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.01f55691-ed89-4d55-8faa-2e1007cfef8c Nov 05 03:50:08 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:09 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.01f55691-ed89-4d55-8faa-2e1007cfef8c" returned: 0 in 0.857s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6f57e4e-f71f-42ea-849d-196389e18ed2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:50:09 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbff9c7-3c16-4fa3-ba08-e0843992acb0]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:09 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c Nov 05 03:50:09 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:09 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c" returned: 0 in 0.573s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6f57e4e-f71f-42ea-849d-196389e18ed2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:50:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.01f55691-ed89-4d55-8faa-2e1007cfef8c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:09 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.01f55691-ed89-4d55-8faa-2e1007cfef8c Nov 05 03:50:09 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:10 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.01f55691-ed89-4d55-8faa-2e1007cfef8c" returned: 0 in 0.666s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.01f55691-ed89-4d55-8faa-2e1007cfef8c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:10 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.01f55691-ed89-4d55-8faa-2e1007cfef8c Nov 05 03:50:10 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:10 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.01f55691-ed89-4d55-8faa-2e1007cfef8c" returned: 0 in 0.635s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-quobyte-01f55691-ed89-4d55-8faa-2e1007cfef8c" released by "_delete_snapshot" :: held 2.944s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-quobyte-b6f57e4e-f71f-42ea-849d-196389e18ed2" released by "delete_snapshot" :: held 2.979s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:11 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] Created reservations ['44ef4607-a752-4cd4-94db-57cc96ba5d25', 'ace327a9-cd52-4c97-8011-422ac41088de', '8db32167-4517-4155-8553-322a9d5b7a74', '3fac587b-e7d1-4670-9dbf-58f6376d2222'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:11 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] Delete snapshot completed successfully. Nov 05 03:50:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c6f105f1-07af-4851-bf3f-3a0053932c63 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-01f55691-ed89-4d55-8faa-2e1007cfef8c-delete_snapshot" released by "delete_snapshot" :: held 3.152s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] Acquiring lock "cinder-a64d1b88-63f6-4ce8-9a47-778d77db385c-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-a64d1b88-63f6-4ce8-9a47-778d77db385c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] Acquiring lock "cinder-quobyte-b6f57e4e-f71f-42ea-849d-196389e18ed2" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-quobyte-b6f57e4e-f71f-42ea-849d-196389e18ed2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] Acquiring lock "cinder-quobyte-a64d1b88-63f6-4ce8-9a47-778d77db385c" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-quobyte-a64d1b88-63f6-4ce8-9a47-778d77db385c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:11 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] Deleting offline snapshot a64d1b88-63f6-4ce8-9a47-778d77db385c of volume b6f57e4e-f71f-42ea-849d-196389e18ed2 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:50:11 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] snapshot_file for this snap is: volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:50:11 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8208f47-de0f-4e7b-96ab-678bcb7bf8dc]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:11 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c Nov 05 03:50:11 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:12 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c" returned: 0 in 0.602s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6f57e4e-f71f-42ea-849d-196389e18ed2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:50:12 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5735c4fe-bc2d-4b3f-9dbc-6869187971fa]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:12 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 Nov 05 03:50:12 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:12 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3" returned: 0 in 0.785s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6f57e4e-f71f-42ea-849d-196389e18ed2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:50:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:12 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c Nov 05 03:50:12 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:13 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c" returned: 0 in 0.899s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:13 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c Nov 05 03:50:13 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:14 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.a64d1b88-63f6-4ce8-9a47-778d77db385c" returned: 0 in 0.308s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-quobyte-a64d1b88-63f6-4ce8-9a47-778d77db385c" released by "_delete_snapshot" :: held 2.761s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-quobyte-b6f57e4e-f71f-42ea-849d-196389e18ed2" released by "delete_snapshot" :: held 2.800s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:14 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] Created reservations ['8aacceff-a62e-44d6-bf0c-235e144dfe04', '37816d84-c567-4777-9661-f7b5ff3abf9a', 'ac6147e0-4e26-4316-b4ae-b4ba8a3dd5d1', 'b8879397-53d1-4acc-b9ac-f7253c2c70a4'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:14 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] Delete snapshot completed successfully. Nov 05 03:50:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3eddf6fa-42bb-4763-a938-eeabe62e65a8 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-a64d1b88-63f6-4ce8-9a47-778d77db385c-delete_snapshot" released by "delete_snapshot" :: held 3.065s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] Acquiring lock "cinder-8701a542-4110-4db9-83c3-7eaf357529c3-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-8701a542-4110-4db9-83c3-7eaf357529c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] Acquiring lock "cinder-quobyte-b6f57e4e-f71f-42ea-849d-196389e18ed2" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-quobyte-b6f57e4e-f71f-42ea-849d-196389e18ed2" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] Acquiring lock "cinder-quobyte-8701a542-4110-4db9-83c3-7eaf357529c3" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-quobyte-8701a542-4110-4db9-83c3-7eaf357529c3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] Deleting offline snapshot 8701a542-4110-4db9-83c3-7eaf357529c3 of volume b6f57e4e-f71f-42ea-849d-196389e18ed2 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:50:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] snapshot_file for this snap is: volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:50:14 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fdb88d-8fea-4e43-b3d8-1102d9906c31]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:15 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 Nov 05 03:50:15 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:15 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3" returned: 0 in 0.725s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6f57e4e-f71f-42ea-849d-196389e18ed2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:50:15 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ddb75a-b92f-434f-91d4-06a782c2431e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:15 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2 Nov 05 03:50:15 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:16 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2" returned: 0 in 0.662s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:16 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 Nov 05 03:50:16 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:16 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3" returned: 0 in 0.561s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:16 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3 Nov 05 03:50:16 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:17 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2.8701a542-4110-4db9-83c3-7eaf357529c3" returned: 0 in 0.431s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:17 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-quobyte-8701a542-4110-4db9-83c3-7eaf357529c3" released by "_delete_snapshot" :: held 2.520s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:17 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-quobyte-b6f57e4e-f71f-42ea-849d-196389e18ed2" released by "delete_snapshot" :: held 2.553s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:17 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] Created reservations ['56dd7615-e7e3-47af-9123-aaa3091a35eb', '22ce6e33-a434-48c6-a20e-e64cda16a824', '722d6b0a-d876-4f49-be8b-15e82f9adb28', '60ec1c7f-105b-4287-8835-9dbc71dab67f'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:17 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] Delete snapshot completed successfully. Nov 05 03:50:17 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0f35eeeb-fb07-4b10-b227-b049f97c8e0b tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-8701a542-4110-4db9-83c3-7eaf357529c3-delete_snapshot" released by "delete_snapshot" :: held 2.809s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:18 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3a262ff4-171c-4dad-8f62-a5693b9aade2 tempest-VolumesSnapshotListTestJSON-447370403 None] Acquiring lock "cinder-b6f57e4e-f71f-42ea-849d-196389e18ed2-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:18 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3a262ff4-171c-4dad-8f62-a5693b9aade2 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-b6f57e4e-f71f-42ea-849d-196389e18ed2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:18 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3a262ff4-171c-4dad-8f62-a5693b9aade2 tempest-VolumesSnapshotListTestJSON-447370403 None] Acquiring lock "cinder-quobyte-b6f57e4e-f71f-42ea-849d-196389e18ed2" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:18 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3a262ff4-171c-4dad-8f62-a5693b9aade2 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-quobyte-b6f57e4e-f71f-42ea-849d-196389e18ed2" acquired by "delete_volume" :: waited 0.022s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:18 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b4f7ae-f21c-4fc4-b041-0413e5337fce]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3a262ff4-171c-4dad-8f62-a5693b9aade2 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:18 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2 Nov 05 03:50:18 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:18 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3a262ff4-171c-4dad-8f62-a5693b9aade2 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2" returned: 0 in 0.546s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3a262ff4-171c-4dad-8f62-a5693b9aade2 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:19 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2 Nov 05 03:50:19 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:19 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3a262ff4-171c-4dad-8f62-a5693b9aade2 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b6f57e4e-f71f-42ea-849d-196389e18ed2" returned: 0 in 0.337s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:19 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3a262ff4-171c-4dad-8f62-a5693b9aade2 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-quobyte-b6f57e4e-f71f-42ea-849d-196389e18ed2" released by "delete_volume" :: held 0.966s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:19 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-3a262ff4-171c-4dad-8f62-a5693b9aade2 tempest-VolumesSnapshotListTestJSON-447370403 None] Created reservations ['fa1f2cbd-a792-449a-82a6-114c5d8ae0f7', '3e578b8a-d1ed-4ada-b1cd-1381546146d0', '131a243d-dfc0-4160-8457-becabb23c000', '120e29e2-57b9-4942-870c-5799626710d2'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3a262ff4-171c-4dad-8f62-a5693b9aade2 tempest-VolumesSnapshotListTestJSON-447370403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3a262ff4-171c-4dad-8f62-a5693b9aade2 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3a262ff4-171c-4dad-8f62-a5693b9aade2 tempest-VolumesSnapshotListTestJSON-447370403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3a262ff4-171c-4dad-8f62-a5693b9aade2 tempest-VolumesSnapshotListTestJSON-447370403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3a262ff4-171c-4dad-8f62-a5693b9aade2 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3a262ff4-171c-4dad-8f62-a5693b9aade2 tempest-VolumesSnapshotListTestJSON-447370403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:19 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:50:19 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:19 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3a262ff4-171c-4dad-8f62-a5693b9aade2 tempest-VolumesSnapshotListTestJSON-447370403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.305s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:19 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-3a262ff4-171c-4dad-8f62-a5693b9aade2 tempest-VolumesSnapshotListTestJSON-447370403 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:19 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-3a262ff4-171c-4dad-8f62-a5693b9aade2 tempest-VolumesSnapshotListTestJSON-447370403 None] Deleted volume successfully. Nov 05 03:50:19 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3a262ff4-171c-4dad-8f62-a5693b9aade2 tempest-VolumesSnapshotListTestJSON-447370403 None] Lock "cinder-b6f57e4e-f71f-42ea-849d-196389e18ed2-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Flow 'volume_create_manager' (7b3826e3-f512-4183-8c9c-206e34d4f482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9eba98f-9035-4c5b-9e37-fa72738072bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9eba98f-9035-4c5b-9e37-fa72738072bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-542407974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ab1a6a6a784e8490d29b5a445092ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:27Z,use_quota=True,user_id='d22d349cd2c24d52ae22365ec6bdae56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1331685c-d6cd-4107-8d0a-d239a815390c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1331685c-d6cd-4107-8d0a-d239a815390c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944fe9a0-82a6-4e25-9bbb-df89b0969871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944fe9a0-82a6-4e25-9bbb-df89b0969871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31', 'volume_name': 'volume-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f718ed8b-0028-44cb-b717-f06773537f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f718ed8b-0028-44cb-b717-f06773537f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f912cb2-4cb5-45da-80ee-f4627a1344a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:27 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Volume 6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31', 'volume_size': 1} Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-542407974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ab1a6a6a784e8490d29b5a445092ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:27Z,use_quota=True,user_id='d22d349cd2c24d52ae22365ec6bdae56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Creating volume 6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:50:27 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:50:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:27 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31 1073741824 Nov 05 03:50:27 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Flow 'volume_create_manager' (184b707a-362b-4fd1-a6f8-646df0786e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30df3b60-e9b5-4016-8cf8-2461fd7e8180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30df3b60-e9b5-4016-8cf8-2461fd7e8180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1631014279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ed2472-4970-43bd-9f56-0cb8b6804d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ab1a6a6a784e8490d29b5a445092ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:28Z,use_quota=True,user_id='d22d349cd2c24d52ae22365ec6bdae56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10fb8453-85bd-42c9-a877-ea26748d146f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10fb8453-85bd-42c9-a877-ea26748d146f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422b3c34-9544-480d-ae2c-11f82295eddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422b3c34-9544-480d-ae2c-11f82295eddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88ed2472-4970-43bd-9f56-0cb8b6804d04', 'volume_name': 'volume-88ed2472-4970-43bd-9f56-0cb8b6804d04', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb203341-52f5-4a7c-9023-011d1b015c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb203341-52f5-4a7c-9023-011d1b015c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9029afc7-e7d1-4a98-896e-5cf385455538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:28 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Volume 88ed2472-4970-43bd-9f56-0cb8b6804d04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88ed2472-4970-43bd-9f56-0cb8b6804d04', 'volume_size': 1} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:28 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31 1073741824" returned: 0 in 0.751s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:28 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31 Nov 05 03:50:28 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Flow 'volume_create_manager' (3e0930ad-8b5b-45ca-95c1-8b461b2744f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5ebba2-8c8d-4119-95f8-c184392f54ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca5ebba2-8c8d-4119-95f8-c184392f54ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-38986274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09923580-2cde-490a-a37a-1677a254e89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ab1a6a6a784e8490d29b5a445092ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:29Z,use_quota=True,user_id='d22d349cd2c24d52ae22365ec6bdae56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628682ab-9b16-44d2-91ae-98c7c4e6d6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:28 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628682ab-9b16-44d2-91ae-98c7c4e6d6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f1d0ce8-d2d7-48eb-878d-d859bdb8a076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f1d0ce8-d2d7-48eb-878d-d859bdb8a076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09923580-2cde-490a-a37a-1677a254e89f', 'volume_name': 'volume-09923580-2cde-490a-a37a-1677a254e89f', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cea86cf-1fd8-4b64-b9f7-511e4fd9b579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cea86cf-1fd8-4b64-b9f7-511e4fd9b579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de648ab1-5b85-4828-bea1-e3730da5b188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:28 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Volume 09923580-2cde-490a-a37a-1677a254e89f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09923580-2cde-490a-a37a-1677a254e89f', 'volume_size': 1} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31" returned: 0 in 0.374s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.543s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1631014279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ed2472-4970-43bd-9f56-0cb8b6804d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ab1a6a6a784e8490d29b5a445092ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:28Z,use_quota=True,user_id='d22d349cd2c24d52ae22365ec6bdae56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Creating volume 88ed2472-4970-43bd-9f56-0cb8b6804d04 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:50:28 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-88ed2472-4970-43bd-9f56-0cb8b6804d04 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f912cb2-4cb5-45da-80ee-f4627a1344a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17bd22a6-94ed-4f6f-a81d-18a4fc5e64f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:28 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-88ed2472-4970-43bd-9f56-0cb8b6804d04 1073741824 Nov 05 03:50:28 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:28 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Volume volume-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31 (6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31): created successfully Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17bd22a6-94ed-4f6f-a81d-18a4fc5e64f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Flow 'volume_create_manager' (7b3826e3-f512-4183-8c9c-206e34d4f482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:28 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b0c3739c-d55b-4d65-8eec-a36561ca1a02 tempest-CreateVolumesFromImageTest-1445945780 None] Created volume successfully. Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Flow 'volume_create_manager' (f02cdc2b-6bca-43f2-891f-7cb718c4e513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b214ca8-08bb-426d-b222-81e6f327a421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:29 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b214ca8-08bb-426d-b222-81e6f327a421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-446230397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cf1c530-0d8e-44db-943f-00593ca53152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ab1a6a6a784e8490d29b5a445092ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:29Z,use_quota=True,user_id='d22d349cd2c24d52ae22365ec6bdae56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c731a4c-46a0-48ba-b388-c9c684f442ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c731a4c-46a0-48ba-b388-c9c684f442ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9c470b-362d-43c8-9b31-202705966995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9c470b-362d-43c8-9b31-202705966995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cf1c530-0d8e-44db-943f-00593ca53152', 'volume_name': 'volume-7cf1c530-0d8e-44db-943f-00593ca53152', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278a6c7b-643c-401a-9e9f-576f7b5b3134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278a6c7b-643c-401a-9e9f-576f7b5b3134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e3313e9-dc35-401e-b5fa-e3ff76f1d678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:29 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Volume 7cf1c530-0d8e-44db-943f-00593ca53152: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cf1c530-0d8e-44db-943f-00593ca53152', 'volume_size': 1} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-88ed2472-4970-43bd-9f56-0cb8b6804d04 1073741824" returned: 0 in 0.768s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-88ed2472-4970-43bd-9f56-0cb8b6804d04 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:29 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-88ed2472-4970-43bd-9f56-0cb8b6804d04 Nov 05 03:50:29 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:29 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-88ed2472-4970-43bd-9f56-0cb8b6804d04" returned: 0 in 0.350s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.199s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-38986274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09923580-2cde-490a-a37a-1677a254e89f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ab1a6a6a784e8490d29b5a445092ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:29Z,use_quota=True,user_id='d22d349cd2c24d52ae22365ec6bdae56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Creating volume 09923580-2cde-490a-a37a-1677a254e89f {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:50:29 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-09923580-2cde-490a-a37a-1677a254e89f 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9029afc7-e7d1-4a98-896e-5cf385455538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88ed2472-4970-43bd-9f56-0cb8b6804d04', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6af2111-2875-49ec-8c75-fc53d0c3246a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:29 devstack sudo[97628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-09923580-2cde-490a-a37a-1677a254e89f 1073741824 Nov 05 03:50:29 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:30 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Volume volume-88ed2472-4970-43bd-9f56-0cb8b6804d04 (88ed2472-4970-43bd-9f56-0cb8b6804d04): created successfully Nov 05 03:50:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6af2111-2875-49ec-8c75-fc53d0c3246a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Flow 'volume_create_manager' (184b707a-362b-4fd1-a6f8-646df0786e6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:30 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:50:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Flow 'volume_create_manager' (f7347f3b-461b-4931-8e07-d06714d66077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c28eb6-ee4a-4020-9a83-e0cfcf6c4359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:30 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b3a53ad5-2840-4f62-b773-0caf7d628d5b tempest-CreateVolumesFromImageTest-1445945780 None] Created volume successfully. Nov 05 03:50:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c28eb6-ee4a-4020-9a83-e0cfcf6c4359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1092635214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72405f73-e32e-4d75-a879-e06d113ad751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ab1a6a6a784e8490d29b5a445092ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:30Z,use_quota=True,user_id='d22d349cd2c24d52ae22365ec6bdae56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87576ef9-092f-470b-b9b2-ab76a97d91f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87576ef9-092f-470b-b9b2-ab76a97d91f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b640d6f-100b-4ea5-aaa4-744bf4d1133a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b640d6f-100b-4ea5-aaa4-744bf4d1133a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72405f73-e32e-4d75-a879-e06d113ad751', 'volume_name': 'volume-72405f73-e32e-4d75-a879-e06d113ad751', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba54c482-69d0-43a1-8ad5-af458900e6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba54c482-69d0-43a1-8ad5-af458900e6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256ce1b4-4cd2-47bd-9cd1-1701c9749fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:30 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Volume 72405f73-e32e-4d75-a879-e06d113ad751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72405f73-e32e-4d75-a879-e06d113ad751', 'volume_size': 1} Nov 05 03:50:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:30 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-09923580-2cde-490a-a37a-1677a254e89f 1073741824" returned: 0 in 0.649s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-09923580-2cde-490a-a37a-1677a254e89f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:30 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-09923580-2cde-490a-a37a-1677a254e89f Nov 05 03:50:30 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:31 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-09923580-2cde-490a-a37a-1677a254e89f" returned: 0 in 0.419s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:50:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.566s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-446230397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cf1c530-0d8e-44db-943f-00593ca53152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ab1a6a6a784e8490d29b5a445092ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:29Z,use_quota=True,user_id='d22d349cd2c24d52ae22365ec6bdae56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:50:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Creating volume 7cf1c530-0d8e-44db-943f-00593ca53152 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:50:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:50:31 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:50:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7cf1c530-0d8e-44db-943f-00593ca53152 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:31 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7cf1c530-0d8e-44db-943f-00593ca53152 1073741824 Nov 05 03:50:31 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de648ab1-5b85-4828-bea1-e3730da5b188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09923580-2cde-490a-a37a-1677a254e89f', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f703806e-76d2-4d15-b072-5e445324763b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:31 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Volume volume-09923580-2cde-490a-a37a-1677a254e89f (09923580-2cde-490a-a37a-1677a254e89f): created successfully Nov 05 03:50:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f703806e-76d2-4d15-b072-5e445324763b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Flow 'volume_create_manager' (3e0930ad-8b5b-45ca-95c1-8b461b2744f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:31 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f59bd2fe-5fcb-4e0e-a357-fdda45f190a6 tempest-CreateVolumesFromImageTest-1445945780 None] Created volume successfully. Nov 05 03:50:31 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7cf1c530-0d8e-44db-943f-00593ca53152 1073741824" returned: 0 in 0.600s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7cf1c530-0d8e-44db-943f-00593ca53152 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:31 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7cf1c530-0d8e-44db-943f-00593ca53152 Nov 05 03:50:31 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:32 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7cf1c530-0d8e-44db-943f-00593ca53152" returned: 0 in 0.301s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:50:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.835s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1092635214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72405f73-e32e-4d75-a879-e06d113ad751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64ab1a6a6a784e8490d29b5a445092ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:30Z,use_quota=True,user_id='d22d349cd2c24d52ae22365ec6bdae56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:50:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Creating volume 72405f73-e32e-4d75-a879-e06d113ad751 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:50:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:50:32 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:50:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-72405f73-e32e-4d75-a879-e06d113ad751 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e3313e9-dc35-401e-b5fa-e3ff76f1d678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cf1c530-0d8e-44db-943f-00593ca53152', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:32 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-72405f73-e32e-4d75-a879-e06d113ad751 1073741824 Nov 05 03:50:32 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a63bf0a-eee2-431d-9d4c-e59f8ca90999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:32 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Volume volume-7cf1c530-0d8e-44db-943f-00593ca53152 (7cf1c530-0d8e-44db-943f-00593ca53152): created successfully Nov 05 03:50:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a63bf0a-eee2-431d-9d4c-e59f8ca90999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Flow 'volume_create_manager' (f02cdc2b-6bca-43f2-891f-7cb718c4e513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:32 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f0331b8d-ffde-475b-a254-9f879993f667 tempest-CreateVolumesFromImageTest-1445945780 None] Created volume successfully. Nov 05 03:50:32 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-72405f73-e32e-4d75-a879-e06d113ad751 1073741824" returned: 0 in 0.710s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-72405f73-e32e-4d75-a879-e06d113ad751 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:32 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-72405f73-e32e-4d75-a879-e06d113ad751 Nov 05 03:50:32 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:33 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-72405f73-e32e-4d75-a879-e06d113ad751" returned: 0 in 0.358s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:50:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256ce1b4-4cd2-47bd-9cd1-1701c9749fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72405f73-e32e-4d75-a879-e06d113ad751', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17642a32-ac6f-4168-b0ed-aae16ca3a82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:33 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Volume volume-72405f73-e32e-4d75-a879-e06d113ad751 (72405f73-e32e-4d75-a879-e06d113ad751): created successfully Nov 05 03:50:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17642a32-ac6f-4168-b0ed-aae16ca3a82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Flow 'volume_create_manager' (f7347f3b-461b-4931-8e07-d06714d66077) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:33 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-ba58a9b8-69c3-4f62-8e96-11a5e2bb39e3 tempest-CreateVolumesFromImageTest-1445945780 None] Created volume successfully. Nov 05 03:50:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8c90ddd7-2e47-4e67-8874-2f49eb32f219 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "cinder-72405f73-e32e-4d75-a879-e06d113ad751-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8c90ddd7-2e47-4e67-8874-2f49eb32f219 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "cinder-72405f73-e32e-4d75-a879-e06d113ad751-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8c90ddd7-2e47-4e67-8874-2f49eb32f219 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "cinder-quobyte-72405f73-e32e-4d75-a879-e06d113ad751" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8c90ddd7-2e47-4e67-8874-2f49eb32f219 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "cinder-quobyte-72405f73-e32e-4d75-a879-e06d113ad751" acquired by "delete_volume" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:33 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[601c32c9-882c-4132-b61c-be2de09849a4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8c90ddd7-2e47-4e67-8874-2f49eb32f219 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-72405f73-e32e-4d75-a879-e06d113ad751 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:33 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-72405f73-e32e-4d75-a879-e06d113ad751 Nov 05 03:50:33 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:34 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8c90ddd7-2e47-4e67-8874-2f49eb32f219 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-72405f73-e32e-4d75-a879-e06d113ad751" returned: 0 in 0.449s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8c90ddd7-2e47-4e67-8874-2f49eb32f219 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-72405f73-e32e-4d75-a879-e06d113ad751 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:34 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-72405f73-e32e-4d75-a879-e06d113ad751 Nov 05 03:50:34 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:34 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8c90ddd7-2e47-4e67-8874-2f49eb32f219 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-72405f73-e32e-4d75-a879-e06d113ad751" returned: 0 in 0.362s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8c90ddd7-2e47-4e67-8874-2f49eb32f219 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "cinder-quobyte-72405f73-e32e-4d75-a879-e06d113ad751" released by "delete_volume" :: held 0.868s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:34 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-8c90ddd7-2e47-4e67-8874-2f49eb32f219 tempest-CreateVolumesFromImageTest-1445945780 None] Created reservations ['d2f70ff6-183b-4d5f-99e7-00b18c12733a', '904d50fa-5f63-4415-8119-300a37541098', '40e7f065-929b-4945-b153-f0938c78eabd', 'b7cf354f-f627-4518-b1ef-af1501b77b50'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8c90ddd7-2e47-4e67-8874-2f49eb32f219 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8c90ddd7-2e47-4e67-8874-2f49eb32f219 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8c90ddd7-2e47-4e67-8874-2f49eb32f219 tempest-CreateVolumesFromImageTest-1445945780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8c90ddd7-2e47-4e67-8874-2f49eb32f219 tempest-CreateVolumesFromImageTest-1445945780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8c90ddd7-2e47-4e67-8874-2f49eb32f219 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8c90ddd7-2e47-4e67-8874-2f49eb32f219 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:34 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:50:34 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6f425e04-6924-45b8-a116-f28bb1e6e483 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "cinder-7cf1c530-0d8e-44db-943f-00593ca53152-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6f425e04-6924-45b8-a116-f28bb1e6e483 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "cinder-7cf1c530-0d8e-44db-943f-00593ca53152-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6f425e04-6924-45b8-a116-f28bb1e6e483 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "cinder-quobyte-7cf1c530-0d8e-44db-943f-00593ca53152" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6f425e04-6924-45b8-a116-f28bb1e6e483 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "cinder-quobyte-7cf1c530-0d8e-44db-943f-00593ca53152" acquired by "delete_volume" :: waited 0.026s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f091c6-f9f0-4ac4-9162-e50a5521d6fc]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6f425e04-6924-45b8-a116-f28bb1e6e483 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7cf1c530-0d8e-44db-943f-00593ca53152 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:50:35 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Flow 'volume_create_manager' (b31fe943-e3a2-49aa-a23b-d877f29082cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204a8802-18f6-45b1-9128-01c92b82f105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8c90ddd7-2e47-4e67-8874-2f49eb32f219 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.662s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-8c90ddd7-2e47-4e67-8874-2f49eb32f219 tempest-CreateVolumesFromImageTest-1445945780 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:35 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-8c90ddd7-2e47-4e67-8874-2f49eb32f219 tempest-CreateVolumesFromImageTest-1445945780 None] Deleted volume successfully. Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204a8802-18f6-45b1-9128-01c92b82f105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-991731571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afabe384-e8fc-4b45-a554-15d0592d588e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c62fcba293f4524ba3ecbb3b1006076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:35Z,use_quota=True,user_id='c67b98e3eb99410f81631f6ab964fd7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:35 devstack sudo[97670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7cf1c530-0d8e-44db-943f-00593ca53152 Nov 05 03:50:35 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff80b47-f5b5-499a-b77a-a0d7df131d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff80b47-f5b5-499a-b77a-a0d7df131d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ea6987-3b4a-4346-9056-8bff5c3770ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ea6987-3b4a-4346-9056-8bff5c3770ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afabe384-e8fc-4b45-a554-15d0592d588e', 'volume_name': 'volume-afabe384-e8fc-4b45-a554-15d0592d588e', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b22ee675-00be-44da-bb65-8b6c72ebb674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b22ee675-00be-44da-bb65-8b6c72ebb674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3435e3d-1bb2-472e-8d0c-4b181938bb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:35 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Volume afabe384-e8fc-4b45-a554-15d0592d588e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afabe384-e8fc-4b45-a554-15d0592d588e', 'volume_size': 1} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-991731571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afabe384-e8fc-4b45-a554-15d0592d588e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c62fcba293f4524ba3ecbb3b1006076',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:50:35Z,use_quota=True,user_id='c67b98e3eb99410f81631f6ab964fd7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Creating volume afabe384-e8fc-4b45-a554-15d0592d588e {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:50:35 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-afabe384-e8fc-4b45-a554-15d0592d588e 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:35 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-afabe384-e8fc-4b45-a554-15d0592d588e 1073741824 Nov 05 03:50:35 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8c90ddd7-2e47-4e67-8874-2f49eb32f219 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "cinder-72405f73-e32e-4d75-a879-e06d113ad751-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:35 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6f425e04-6924-45b8-a116-f28bb1e6e483 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7cf1c530-0d8e-44db-943f-00593ca53152" returned: 0 in 0.618s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6f425e04-6924-45b8-a116-f28bb1e6e483 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7cf1c530-0d8e-44db-943f-00593ca53152 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:35 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7cf1c530-0d8e-44db-943f-00593ca53152 Nov 05 03:50:35 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:36 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-afabe384-e8fc-4b45-a554-15d0592d588e 1073741824" returned: 0 in 0.780s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:36 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6f425e04-6924-45b8-a116-f28bb1e6e483 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7cf1c530-0d8e-44db-943f-00593ca53152" returned: 0 in 0.533s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6f425e04-6924-45b8-a116-f28bb1e6e483 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "cinder-quobyte-7cf1c530-0d8e-44db-943f-00593ca53152" released by "delete_volume" :: held 1.254s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-afabe384-e8fc-4b45-a554-15d0592d588e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:36 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-afabe384-e8fc-4b45-a554-15d0592d588e Nov 05 03:50:36 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:36 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-6f425e04-6924-45b8-a116-f28bb1e6e483 tempest-CreateVolumesFromImageTest-1445945780 None] Created reservations ['d8b19338-b879-44f1-afde-e97f3483fdf2', '3354349d-3145-44e0-ae01-beac3b70e73e', '09b32fbd-fb67-4284-9386-a4965b743d98', '449535d3-db2c-4eea-87a3-a249b0ddfb1d'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6f425e04-6924-45b8-a116-f28bb1e6e483 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6f425e04-6924-45b8-a116-f28bb1e6e483 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6f425e04-6924-45b8-a116-f28bb1e6e483 tempest-CreateVolumesFromImageTest-1445945780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6f425e04-6924-45b8-a116-f28bb1e6e483 tempest-CreateVolumesFromImageTest-1445945780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6f425e04-6924-45b8-a116-f28bb1e6e483 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6f425e04-6924-45b8-a116-f28bb1e6e483 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:36 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:50:36 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:36 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-afabe384-e8fc-4b45-a554-15d0592d588e" returned: 0 in 0.326s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:50:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3435e3d-1bb2-472e-8d0c-4b181938bb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afabe384-e8fc-4b45-a554-15d0592d588e', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8d61b4-19ae-415b-8ce2-cd594832be75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:50:36 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Volume volume-afabe384-e8fc-4b45-a554-15d0592d588e (afabe384-e8fc-4b45-a554-15d0592d588e): created successfully Nov 05 03:50:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8d61b4-19ae-415b-8ce2-cd594832be75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:50:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Flow 'volume_create_manager' (b31fe943-e3a2-49aa-a23b-d877f29082cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:50:36 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-62fd4fb6-356e-4ef2-ac59-2d20f315fc6c tempest-AttachVolumeNegativeTest-671600555 None] Created volume successfully. Nov 05 03:50:36 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6f425e04-6924-45b8-a116-f28bb1e6e483 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.318s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:37 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-6f425e04-6924-45b8-a116-f28bb1e6e483 tempest-CreateVolumesFromImageTest-1445945780 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:37 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-6f425e04-6924-45b8-a116-f28bb1e6e483 tempest-CreateVolumesFromImageTest-1445945780 None] Deleted volume successfully. Nov 05 03:50:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6f425e04-6924-45b8-a116-f28bb1e6e483 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "cinder-7cf1c530-0d8e-44db-943f-00593ca53152-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-02fd4a0f-ed5d-4d1f-a8ec-2c12e7928a83 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "cinder-09923580-2cde-490a-a37a-1677a254e89f-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-02fd4a0f-ed5d-4d1f-a8ec-2c12e7928a83 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "cinder-09923580-2cde-490a-a37a-1677a254e89f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-02fd4a0f-ed5d-4d1f-a8ec-2c12e7928a83 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "cinder-quobyte-09923580-2cde-490a-a37a-1677a254e89f" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-02fd4a0f-ed5d-4d1f-a8ec-2c12e7928a83 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "cinder-quobyte-09923580-2cde-490a-a37a-1677a254e89f" acquired by "delete_volume" :: waited 0.031s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:37 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ec2773-bc7a-4f44-aa8b-1465a43a17df]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02fd4a0f-ed5d-4d1f-a8ec-2c12e7928a83 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-09923580-2cde-490a-a37a-1677a254e89f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:37 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-09923580-2cde-490a-a37a-1677a254e89f Nov 05 03:50:37 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:38 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02fd4a0f-ed5d-4d1f-a8ec-2c12e7928a83 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-09923580-2cde-490a-a37a-1677a254e89f" returned: 0 in 0.617s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02fd4a0f-ed5d-4d1f-a8ec-2c12e7928a83 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-09923580-2cde-490a-a37a-1677a254e89f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:38 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-09923580-2cde-490a-a37a-1677a254e89f Nov 05 03:50:38 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:38 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02fd4a0f-ed5d-4d1f-a8ec-2c12e7928a83 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-09923580-2cde-490a-a37a-1677a254e89f" returned: 0 in 0.420s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:38 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-02fd4a0f-ed5d-4d1f-a8ec-2c12e7928a83 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "cinder-quobyte-09923580-2cde-490a-a37a-1677a254e89f" released by "delete_volume" :: held 1.135s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:39 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-02fd4a0f-ed5d-4d1f-a8ec-2c12e7928a83 tempest-CreateVolumesFromImageTest-1445945780 None] Created reservations ['38b5be37-6c02-4777-9448-850a74a3f22c', 'd996c1f6-6ce7-4e17-ad27-b9b6870ef57a', 'a043599c-9b82-4aa6-9973-199ebaf684cd', 'c4d8cdf6-a34c-4da2-884b-c38ae0be22b5'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-02fd4a0f-ed5d-4d1f-a8ec-2c12e7928a83 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-02fd4a0f-ed5d-4d1f-a8ec-2c12e7928a83 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-02fd4a0f-ed5d-4d1f-a8ec-2c12e7928a83 tempest-CreateVolumesFromImageTest-1445945780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-02fd4a0f-ed5d-4d1f-a8ec-2c12e7928a83 tempest-CreateVolumesFromImageTest-1445945780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-02fd4a0f-ed5d-4d1f-a8ec-2c12e7928a83 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02fd4a0f-ed5d-4d1f-a8ec-2c12e7928a83 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:39 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:50:39 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-84288e91-e3c1-4471-b961-62f59c81c92d req-8b0c9293-2559-4d35-9884-c22729e15165 tempest-AttachVolumeNegativeTest-671600555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-84288e91-e3c1-4471-b961-62f59c81c92d req-8b0c9293-2559-4d35-9884-c22729e15165 tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-84288e91-e3c1-4471-b961-62f59c81c92d req-8b0c9293-2559-4d35-9884-c22729e15165 tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:39 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-84288e91-e3c1-4471-b961-62f59c81c92d req-8b0c9293-2559-4d35-9884-c22729e15165 tempest-AttachVolumeNegativeTest-671600555 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-afabe384-e8fc-4b45-a554-15d0592d588e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28c6f3a5-37a9-4b1d-9b3c-3913d5785edb', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:50:39 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-84288e91-e3c1-4471-b961-62f59c81c92d req-8b0c9293-2559-4d35-9884-c22729e15165 tempest-AttachVolumeNegativeTest-671600555 None] attachment_update completed successfully. Nov 05 03:50:39 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:39 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-589e8a2a-75ea-48c4-a632-375055c382d7 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "cinder-88ed2472-4970-43bd-9f56-0cb8b6804d04-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02fd4a0f-ed5d-4d1f-a8ec-2c12e7928a83 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.721s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:39 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-02fd4a0f-ed5d-4d1f-a8ec-2c12e7928a83 tempest-CreateVolumesFromImageTest-1445945780 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:39 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-02fd4a0f-ed5d-4d1f-a8ec-2c12e7928a83 tempest-CreateVolumesFromImageTest-1445945780 None] Deleted volume successfully. Nov 05 03:50:39 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-589e8a2a-75ea-48c4-a632-375055c382d7 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "cinder-88ed2472-4970-43bd-9f56-0cb8b6804d04-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:40 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-02fd4a0f-ed5d-4d1f-a8ec-2c12e7928a83 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "cinder-09923580-2cde-490a-a37a-1677a254e89f-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:40 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-589e8a2a-75ea-48c4-a632-375055c382d7 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "cinder-quobyte-88ed2472-4970-43bd-9f56-0cb8b6804d04" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:40 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-589e8a2a-75ea-48c4-a632-375055c382d7 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "cinder-quobyte-88ed2472-4970-43bd-9f56-0cb8b6804d04" acquired by "delete_volume" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:40 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e041785-efd0-45a7-be67-7dfa3f79f82f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-589e8a2a-75ea-48c4-a632-375055c382d7 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-88ed2472-4970-43bd-9f56-0cb8b6804d04 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:40 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-88ed2472-4970-43bd-9f56-0cb8b6804d04 Nov 05 03:50:40 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:40 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-589e8a2a-75ea-48c4-a632-375055c382d7 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-88ed2472-4970-43bd-9f56-0cb8b6804d04" returned: 0 in 0.770s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-589e8a2a-75ea-48c4-a632-375055c382d7 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-88ed2472-4970-43bd-9f56-0cb8b6804d04 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:41 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-88ed2472-4970-43bd-9f56-0cb8b6804d04 Nov 05 03:50:41 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:41 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-589e8a2a-75ea-48c4-a632-375055c382d7 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-88ed2472-4970-43bd-9f56-0cb8b6804d04" returned: 0 in 0.743s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:41 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-589e8a2a-75ea-48c4-a632-375055c382d7 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "cinder-quobyte-88ed2472-4970-43bd-9f56-0cb8b6804d04" released by "delete_volume" :: held 1.597s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:41 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-589e8a2a-75ea-48c4-a632-375055c382d7 tempest-CreateVolumesFromImageTest-1445945780 None] Created reservations ['ad024c6f-d3f1-44f0-ae01-6d906e108d52', '7bf0832b-56dd-4a80-af4a-87b5b7261998', '86ffb9bc-ff6e-478e-a31c-2559713b1323', '16e03e53-0376-4d90-860c-a86faa6e5444'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-589e8a2a-75ea-48c4-a632-375055c382d7 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-589e8a2a-75ea-48c4-a632-375055c382d7 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:41 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-589e8a2a-75ea-48c4-a632-375055c382d7 tempest-CreateVolumesFromImageTest-1445945780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:41 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-589e8a2a-75ea-48c4-a632-375055c382d7 tempest-CreateVolumesFromImageTest-1445945780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-589e8a2a-75ea-48c4-a632-375055c382d7 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-589e8a2a-75ea-48c4-a632-375055c382d7 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:42 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:50:42 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:42 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-589e8a2a-75ea-48c4-a632-375055c382d7 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.620s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:42 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-589e8a2a-75ea-48c4-a632-375055c382d7 tempest-CreateVolumesFromImageTest-1445945780 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:42 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-589e8a2a-75ea-48c4-a632-375055c382d7 tempest-CreateVolumesFromImageTest-1445945780 None] Deleted volume successfully. Nov 05 03:50:42 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a58450ff-ddb1-4b30-ab1b-8b8bc247bbc9 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "cinder-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:42 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a58450ff-ddb1-4b30-ab1b-8b8bc247bbc9 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "cinder-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:42 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-589e8a2a-75ea-48c4-a632-375055c382d7 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "cinder-88ed2472-4970-43bd-9f56-0cb8b6804d04-delete_volume" released by "delete_volume" :: held 2.753s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:42 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a58450ff-ddb1-4b30-ab1b-8b8bc247bbc9 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "cinder-quobyte-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:42 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a58450ff-ddb1-4b30-ab1b-8b8bc247bbc9 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "cinder-quobyte-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31" acquired by "delete_volume" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:42 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3386d0cd-060a-43a6-b9cb-23870ca53414]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a58450ff-ddb1-4b30-ab1b-8b8bc247bbc9 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:43 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31 Nov 05 03:50:43 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:43 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a58450ff-ddb1-4b30-ab1b-8b8bc247bbc9 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31" returned: 0 in 0.763s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a58450ff-ddb1-4b30-ab1b-8b8bc247bbc9 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:43 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31 Nov 05 03:50:43 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:44 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-2543e434-1bc4-4726-a4a8-85e3aecf71de req-6c2b7cb1-8d08-4f77-ae2e-2ffa3739fa85 tempest-AttachVolumeNegativeTest-671600555 None] Terminate volume connection completed successfully. Nov 05 03:50:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-2543e434-1bc4-4726-a4a8-85e3aecf71de req-6c2b7cb1-8d08-4f77-ae2e-2ffa3739fa85 tempest-AttachVolumeNegativeTest-671600555 None] Deleting attachment 28c6f3a5-37a9-4b1d-9b3c-3913d5785edb. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:50:44 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a58450ff-ddb1-4b30-ab1b-8b8bc247bbc9 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31" returned: 0 in 0.584s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a58450ff-ddb1-4b30-ab1b-8b8bc247bbc9 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "cinder-quobyte-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31" released by "delete_volume" :: held 1.441s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:44 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-a58450ff-ddb1-4b30-ab1b-8b8bc247bbc9 tempest-CreateVolumesFromImageTest-1445945780 None] Created reservations ['fb273bc4-aa98-4b44-9970-7a348ce3c8c7', '223e13f5-f99d-47f6-88f0-2ba29c901415', '7589957f-c6fe-48a7-9993-cb36a1e6462d', '9b9d1236-892d-4026-8f26-40ac3bddf874'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a58450ff-ddb1-4b30-ab1b-8b8bc247bbc9 tempest-CreateVolumesFromImageTest-1445945780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a58450ff-ddb1-4b30-ab1b-8b8bc247bbc9 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a58450ff-ddb1-4b30-ab1b-8b8bc247bbc9 tempest-CreateVolumesFromImageTest-1445945780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a58450ff-ddb1-4b30-ab1b-8b8bc247bbc9 tempest-CreateVolumesFromImageTest-1445945780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a58450ff-ddb1-4b30-ab1b-8b8bc247bbc9 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a58450ff-ddb1-4b30-ab1b-8b8bc247bbc9 tempest-CreateVolumesFromImageTest-1445945780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:44 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:50:44 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:44 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a58450ff-ddb1-4b30-ab1b-8b8bc247bbc9 tempest-CreateVolumesFromImageTest-1445945780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.418s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:44 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-a58450ff-ddb1-4b30-ab1b-8b8bc247bbc9 tempest-CreateVolumesFromImageTest-1445945780 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:45 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-a58450ff-ddb1-4b30-ab1b-8b8bc247bbc9 tempest-CreateVolumesFromImageTest-1445945780 None] Deleted volume successfully. Nov 05 03:50:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a58450ff-ddb1-4b30-ab1b-8b8bc247bbc9 tempest-CreateVolumesFromImageTest-1445945780 None] Lock "cinder-6a4c2c6a-7513-4c3c-8be7-d7bb9a301c31-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7e7d773b-832d-4ea6-8046-7f60ac5261a1 tempest-AttachVolumeNegativeTest-671600555 None] Acquiring lock "cinder-afabe384-e8fc-4b45-a554-15d0592d588e-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7e7d773b-832d-4ea6-8046-7f60ac5261a1 tempest-AttachVolumeNegativeTest-671600555 None] Lock "cinder-afabe384-e8fc-4b45-a554-15d0592d588e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7e7d773b-832d-4ea6-8046-7f60ac5261a1 tempest-AttachVolumeNegativeTest-671600555 None] Acquiring lock "cinder-quobyte-afabe384-e8fc-4b45-a554-15d0592d588e" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7e7d773b-832d-4ea6-8046-7f60ac5261a1 tempest-AttachVolumeNegativeTest-671600555 None] Lock "cinder-quobyte-afabe384-e8fc-4b45-a554-15d0592d588e" acquired by "delete_volume" :: waited 0.020s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:53 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f8e2f2-12f2-47a7-ac1c-3e8d7f5d71f1]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7e7d773b-832d-4ea6-8046-7f60ac5261a1 tempest-AttachVolumeNegativeTest-671600555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-afabe384-e8fc-4b45-a554-15d0592d588e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:53 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-afabe384-e8fc-4b45-a554-15d0592d588e Nov 05 03:50:53 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:54 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7e7d773b-832d-4ea6-8046-7f60ac5261a1 tempest-AttachVolumeNegativeTest-671600555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-afabe384-e8fc-4b45-a554-15d0592d588e" returned: 0 in 0.446s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7e7d773b-832d-4ea6-8046-7f60ac5261a1 tempest-AttachVolumeNegativeTest-671600555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-afabe384-e8fc-4b45-a554-15d0592d588e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:54 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-afabe384-e8fc-4b45-a554-15d0592d588e Nov 05 03:50:54 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:54 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7e7d773b-832d-4ea6-8046-7f60ac5261a1 tempest-AttachVolumeNegativeTest-671600555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-afabe384-e8fc-4b45-a554-15d0592d588e" returned: 0 in 0.286s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7e7d773b-832d-4ea6-8046-7f60ac5261a1 tempest-AttachVolumeNegativeTest-671600555 None] Lock "cinder-quobyte-afabe384-e8fc-4b45-a554-15d0592d588e" released by "delete_volume" :: held 0.792s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:54 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-7e7d773b-832d-4ea6-8046-7f60ac5261a1 tempest-AttachVolumeNegativeTest-671600555 None] Created reservations ['46064f6e-15f7-488f-9ff2-747d72869f27', '38da9cb1-a59c-4ea1-91f4-3fc27c6274da', '104450cb-943e-42ae-a66c-2a7646dead86', 'd5d94948-b7b6-4cbd-a675-de46781ef5c7'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7e7d773b-832d-4ea6-8046-7f60ac5261a1 tempest-AttachVolumeNegativeTest-671600555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7e7d773b-832d-4ea6-8046-7f60ac5261a1 tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7e7d773b-832d-4ea6-8046-7f60ac5261a1 tempest-AttachVolumeNegativeTest-671600555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7e7d773b-832d-4ea6-8046-7f60ac5261a1 tempest-AttachVolumeNegativeTest-671600555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7e7d773b-832d-4ea6-8046-7f60ac5261a1 tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7e7d773b-832d-4ea6-8046-7f60ac5261a1 tempest-AttachVolumeNegativeTest-671600555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:54 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:50:54 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fd2c5681-d819-4513-a461-d3b1bd4f1248 tempest-AttachVolumeNegativeTest-671600555 None] Acquiring lock "cinder-98d96f5f-c2e4-460b-9ec6-e728353f47b2-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fd2c5681-d819-4513-a461-d3b1bd4f1248 tempest-AttachVolumeNegativeTest-671600555 None] Lock "cinder-98d96f5f-c2e4-460b-9ec6-e728353f47b2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:55 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7e7d773b-832d-4ea6-8046-7f60ac5261a1 tempest-AttachVolumeNegativeTest-671600555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.446s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:55 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-7e7d773b-832d-4ea6-8046-7f60ac5261a1 tempest-AttachVolumeNegativeTest-671600555 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:55 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-7e7d773b-832d-4ea6-8046-7f60ac5261a1 tempest-AttachVolumeNegativeTest-671600555 None] Deleted volume successfully. Nov 05 03:50:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fd2c5681-d819-4513-a461-d3b1bd4f1248 tempest-AttachVolumeNegativeTest-671600555 None] Acquiring lock "cinder-quobyte-98d96f5f-c2e4-460b-9ec6-e728353f47b2" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7e7d773b-832d-4ea6-8046-7f60ac5261a1 tempest-AttachVolumeNegativeTest-671600555 None] Lock "cinder-afabe384-e8fc-4b45-a554-15d0592d588e-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fd2c5681-d819-4513-a461-d3b1bd4f1248 tempest-AttachVolumeNegativeTest-671600555 None] Lock "cinder-quobyte-98d96f5f-c2e4-460b-9ec6-e728353f47b2" acquired by "delete_volume" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:55 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0bd0c3-8e68-44a1-9024-e06e500dc069]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fd2c5681-d819-4513-a461-d3b1bd4f1248 tempest-AttachVolumeNegativeTest-671600555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-98d96f5f-c2e4-460b-9ec6-e728353f47b2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:55 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-98d96f5f-c2e4-460b-9ec6-e728353f47b2 Nov 05 03:50:55 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:55 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fd2c5681-d819-4513-a461-d3b1bd4f1248 tempest-AttachVolumeNegativeTest-671600555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-98d96f5f-c2e4-460b-9ec6-e728353f47b2" returned: 0 in 0.379s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fd2c5681-d819-4513-a461-d3b1bd4f1248 tempest-AttachVolumeNegativeTest-671600555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-98d96f5f-c2e4-460b-9ec6-e728353f47b2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:55 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-98d96f5f-c2e4-460b-9ec6-e728353f47b2 Nov 05 03:50:55 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:55 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fd2c5681-d819-4513-a461-d3b1bd4f1248 tempest-AttachVolumeNegativeTest-671600555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-98d96f5f-c2e4-460b-9ec6-e728353f47b2" returned: 0 in 0.275s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fd2c5681-d819-4513-a461-d3b1bd4f1248 tempest-AttachVolumeNegativeTest-671600555 None] Lock "cinder-quobyte-98d96f5f-c2e4-460b-9ec6-e728353f47b2" released by "delete_volume" :: held 0.709s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:55 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-fd2c5681-d819-4513-a461-d3b1bd4f1248 tempest-AttachVolumeNegativeTest-671600555 None] Created reservations ['33beb34f-9df9-41aa-b2e5-5d69d5497e55', 'b265b7a9-d7f5-4c33-a9a0-ab34647ef06c', '7d055de9-cf68-4926-af25-d3a71297abdd', 'f15380c2-3b6f-4924-9e2a-5fb8b8280ec6'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-fd2c5681-d819-4513-a461-d3b1bd4f1248 tempest-AttachVolumeNegativeTest-671600555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-fd2c5681-d819-4513-a461-d3b1bd4f1248 tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-fd2c5681-d819-4513-a461-d3b1bd4f1248 tempest-AttachVolumeNegativeTest-671600555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-fd2c5681-d819-4513-a461-d3b1bd4f1248 tempest-AttachVolumeNegativeTest-671600555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-fd2c5681-d819-4513-a461-d3b1bd4f1248 tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fd2c5681-d819-4513-a461-d3b1bd4f1248 tempest-AttachVolumeNegativeTest-671600555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:55 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:50:55 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:56 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fd2c5681-d819-4513-a461-d3b1bd4f1248 tempest-AttachVolumeNegativeTest-671600555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.426s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:56 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-fd2c5681-d819-4513-a461-d3b1bd4f1248 tempest-AttachVolumeNegativeTest-671600555 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:56 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-fd2c5681-d819-4513-a461-d3b1bd4f1248 tempest-AttachVolumeNegativeTest-671600555 None] Deleted volume successfully. Nov 05 03:50:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fd2c5681-d819-4513-a461-d3b1bd4f1248 tempest-AttachVolumeNegativeTest-671600555 None] Lock "cinder-98d96f5f-c2e4-460b-9ec6-e728353f47b2-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a25f2de7-59c9-405a-ac0c-e98791a22394 tempest-AttachVolumeNegativeTest-671600555 None] Acquiring lock "cinder-811c2078-604d-43ea-a704-6ef87256deac-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a25f2de7-59c9-405a-ac0c-e98791a22394 tempest-AttachVolumeNegativeTest-671600555 None] Lock "cinder-811c2078-604d-43ea-a704-6ef87256deac-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a25f2de7-59c9-405a-ac0c-e98791a22394 tempest-AttachVolumeNegativeTest-671600555 None] Acquiring lock "cinder-quobyte-811c2078-604d-43ea-a704-6ef87256deac" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:50:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a25f2de7-59c9-405a-ac0c-e98791a22394 tempest-AttachVolumeNegativeTest-671600555 None] Lock "cinder-quobyte-811c2078-604d-43ea-a704-6ef87256deac" acquired by "delete_volume" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:50:56 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff96b423-69af-45ff-b732-c9e283c59a7d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:50:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a25f2de7-59c9-405a-ac0c-e98791a22394 tempest-AttachVolumeNegativeTest-671600555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-811c2078-604d-43ea-a704-6ef87256deac {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:56 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-811c2078-604d-43ea-a704-6ef87256deac Nov 05 03:50:56 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:57 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a25f2de7-59c9-405a-ac0c-e98791a22394 tempest-AttachVolumeNegativeTest-671600555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-811c2078-604d-43ea-a704-6ef87256deac" returned: 0 in 0.438s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a25f2de7-59c9-405a-ac0c-e98791a22394 tempest-AttachVolumeNegativeTest-671600555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-811c2078-604d-43ea-a704-6ef87256deac {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:57 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-811c2078-604d-43ea-a704-6ef87256deac Nov 05 03:50:57 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:57 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a25f2de7-59c9-405a-ac0c-e98791a22394 tempest-AttachVolumeNegativeTest-671600555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-811c2078-604d-43ea-a704-6ef87256deac" returned: 0 in 0.280s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a25f2de7-59c9-405a-ac0c-e98791a22394 tempest-AttachVolumeNegativeTest-671600555 None] Lock "cinder-quobyte-811c2078-604d-43ea-a704-6ef87256deac" released by "delete_volume" :: held 0.760s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:57 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-a25f2de7-59c9-405a-ac0c-e98791a22394 tempest-AttachVolumeNegativeTest-671600555 None] Created reservations ['1b3433fe-768a-470c-ab65-56b90d938cf3', '140e1808-ec7a-470d-9c41-ad607856466d', '49caeae0-3ac6-4ba4-8c38-a83ef4fbd187', '049a4a71-f9d4-424b-b8e1-900cea0f0f3c'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:50:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a25f2de7-59c9-405a-ac0c-e98791a22394 tempest-AttachVolumeNegativeTest-671600555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a25f2de7-59c9-405a-ac0c-e98791a22394 tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a25f2de7-59c9-405a-ac0c-e98791a22394 tempest-AttachVolumeNegativeTest-671600555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a25f2de7-59c9-405a-ac0c-e98791a22394 tempest-AttachVolumeNegativeTest-671600555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a25f2de7-59c9-405a-ac0c-e98791a22394 tempest-AttachVolumeNegativeTest-671600555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a25f2de7-59c9-405a-ac0c-e98791a22394 tempest-AttachVolumeNegativeTest-671600555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:57 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:50:57 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:57 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a25f2de7-59c9-405a-ac0c-e98791a22394 tempest-AttachVolumeNegativeTest-671600555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.318s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:57 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-a25f2de7-59c9-405a-ac0c-e98791a22394 tempest-AttachVolumeNegativeTest-671600555 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:57 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-a25f2de7-59c9-405a-ac0c-e98791a22394 tempest-AttachVolumeNegativeTest-671600555 None] Deleted volume successfully. Nov 05 03:50:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a25f2de7-59c9-405a-ac0c-e98791a22394 tempest-AttachVolumeNegativeTest-671600555 None] Lock "cinder-811c2078-604d-43ea-a704-6ef87256deac-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:50:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:50:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:50:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:50:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:50:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:50:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:50:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:50:58 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:50:58 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:50:58 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Nov 05 03:50:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.313s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:50:58 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:50:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:50:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 28 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:50:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:51:07 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=90,cinder:INSERT=26,cinder:UPDATE=109,cinder:DELETE=6 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:51:07 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=88,cinder:UPDATE=109,cinder:DELETE=10,cinder:INSERT=28 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Flow 'volume_create_manager' (459a736a-dcba-4ed9-abe2-157d7143d02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca87475-6cd6-4b1e-af56-9010e07369f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca87475-6cd6-4b1e-af56-9010e07369f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-307150591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e334df-60ec-480d-8488-cb6810bc4bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fbab791622745fe848c9a60281c977a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:10Z,use_quota=True,user_id='c87d6774e1cf48f390df82b3aa7a465b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82765371-ca2b-4c40-ae3f-b84ae270dd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82765371-ca2b-4c40-ae3f-b84ae270dd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c5e1ca-895d-4b87-b06b-69cc3e287971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c5e1ca-895d-4b87-b06b-69cc3e287971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49e334df-60ec-480d-8488-cb6810bc4bbc', 'volume_name': 'volume-49e334df-60ec-480d-8488-cb6810bc4bbc', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd2911d-d50f-4dbe-8fa8-74279899462b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd2911d-d50f-4dbe-8fa8-74279899462b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63579382-72c1-4139-8486-07d2d8ced567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:10 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Volume 49e334df-60ec-480d-8488-cb6810bc4bbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49e334df-60ec-480d-8488-cb6810bc4bbc', 'volume_size': 1} Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-307150591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e334df-60ec-480d-8488-cb6810bc4bbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fbab791622745fe848c9a60281c977a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:10Z,use_quota=True,user_id='c87d6774e1cf48f390df82b3aa7a465b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Creating volume 49e334df-60ec-480d-8488-cb6810bc4bbc {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:51:10 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:51:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-49e334df-60ec-480d-8488-cb6810bc4bbc 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:10 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-49e334df-60ec-480d-8488-cb6810bc4bbc 1073741824 Nov 05 03:51:10 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:11 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-49e334df-60ec-480d-8488-cb6810bc4bbc 1073741824" returned: 0 in 0.705s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-49e334df-60ec-480d-8488-cb6810bc4bbc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:11 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-49e334df-60ec-480d-8488-cb6810bc4bbc Nov 05 03:51:11 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:11 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-49e334df-60ec-480d-8488-cb6810bc4bbc" returned: 0 in 0.356s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:11 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:51:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63579382-72c1-4139-8486-07d2d8ced567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49e334df-60ec-480d-8488-cb6810bc4bbc', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c5513e-2546-4030-9d3d-5cf9f693803b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:11 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Volume volume-49e334df-60ec-480d-8488-cb6810bc4bbc (49e334df-60ec-480d-8488-cb6810bc4bbc): created successfully Nov 05 03:51:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c5513e-2546-4030-9d3d-5cf9f693803b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Flow 'volume_create_manager' (459a736a-dcba-4ed9-abe2-157d7143d02e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:11 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-7c451666-2917-4a48-85aa-81f539d1bd87 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Created volume successfully. Nov 05 03:51:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-a88a56fe-0b7f-4b5b-ae8f-c1cfb0b09cb5 req-d7cf98e8-9865-4143-b570-eee22247d3d1 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-a88a56fe-0b7f-4b5b-ae8f-c1cfb0b09cb5 req-d7cf98e8-9865-4143-b570-eee22247d3d1 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-a88a56fe-0b7f-4b5b-ae8f-c1cfb0b09cb5 req-d7cf98e8-9865-4143-b570-eee22247d3d1 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-a88a56fe-0b7f-4b5b-ae8f-c1cfb0b09cb5 req-d7cf98e8-9865-4143-b570-eee22247d3d1 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-49e334df-60ec-480d-8488-cb6810bc4bbc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd28384d8-e6eb-49d8-82fc-2f9fc0c35497', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:51:14 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-a88a56fe-0b7f-4b5b-ae8f-c1cfb0b09cb5 req-d7cf98e8-9865-4143-b570-eee22247d3d1 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] attachment_update completed successfully. Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Flow 'volume_create_manager' (b1b1d504-7123-47cd-a244-7bfd6e81f49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cb0af9-0900-456a-a2b9-e74d84690b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cb0af9-0900-456a-a2b9-e74d84690b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-112817247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1177f9b-3ea7-4cca-be4b-f9fdecc00425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9bb26d0825b41b69b01bdc1c03d0cfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:17Z,use_quota=True,user_id='4ad59519775c4d63b625b8165c52405e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0582146-9b42-418e-b994-d463108c2c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0582146-9b42-418e-b994-d463108c2c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea534b54-ffbe-4b5f-8ef7-bbcc8d992a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea534b54-ffbe-4b5f-8ef7-bbcc8d992a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1177f9b-3ea7-4cca-be4b-f9fdecc00425', 'volume_name': 'volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ada0ba0b-633e-4efd-8f1b-c2a99fa96d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ada0ba0b-633e-4efd-8f1b-c2a99fa96d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a86ce724-e659-4682-81a3-61bad8812fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:16 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Volume e1177f9b-3ea7-4cca-be4b-f9fdecc00425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425', 'volume_size': 1} Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-112817247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1177f9b-3ea7-4cca-be4b-f9fdecc00425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9bb26d0825b41b69b01bdc1c03d0cfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:17Z,use_quota=True,user_id='4ad59519775c4d63b625b8165c52405e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Creating volume e1177f9b-3ea7-4cca-be4b-f9fdecc00425 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:51:16 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:51:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:16 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425 1073741824 Nov 05 03:51:16 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:17 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425 1073741824" returned: 0 in 0.636s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:17 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425 Nov 05 03:51:17 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:17 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425" returned: 0 in 0.372s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:51:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a86ce724-e659-4682-81a3-61bad8812fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45edb0e5-8945-4b78-9340-dc7c7ae4bd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:17 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Volume volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425 (e1177f9b-3ea7-4cca-be4b-f9fdecc00425): created successfully Nov 05 03:51:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45edb0e5-8945-4b78-9340-dc7c7ae4bd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Flow 'volume_create_manager' (b1b1d504-7123-47cd-a244-7bfd6e81f49d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:17 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-18f1651e-aa23-4cbe-8b49-a527dd9492d9 req-15624c0d-48b1-4275-90ab-4982e175f20f tempest-VolumesSnapshotsTestJSON-24727290 None] Created volume successfully. Nov 05 03:51:19 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-e14f51e6-0c49-41f7-9187-67c9f3386ec9 req-a139cb26-0922-4f26-9354-ef3da1ca7260 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Terminate volume connection completed successfully. Nov 05 03:51:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-e14f51e6-0c49-41f7-9187-67c9f3386ec9 req-a139cb26-0922-4f26-9354-ef3da1ca7260 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Deleting attachment d28384d8-e6eb-49d8-82fc-2f9fc0c35497. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:51:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-5423d35a-af86-411c-92e6-2ab40ba3d377 req-768add1e-b6b3-47d1-a86a-0846cef63d1d tempest-VolumesSnapshotsTestJSON-24727290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-5423d35a-af86-411c-92e6-2ab40ba3d377 req-768add1e-b6b3-47d1-a86a-0846cef63d1d tempest-VolumesSnapshotsTestJSON-24727290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [req-5423d35a-af86-411c-92e6-2ab40ba3d377 req-768add1e-b6b3-47d1-a86a-0846cef63d1d tempest-VolumesSnapshotsTestJSON-24727290 None] Creating offline snapshot 3b2cec87-070b-4338-bcfe-be54d4aa60cc of volume e1177f9b-3ea7-4cca-be4b-f9fdecc00425 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:51:19 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e1fb6b-c339-4f8d-be75-a1a35fbaed15]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-5423d35a-af86-411c-92e6-2ab40ba3d377 req-768add1e-b6b3-47d1-a86a-0846cef63d1d tempest-VolumesSnapshotsTestJSON-24727290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:20 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425 Nov 05 03:51:20 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:20 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-5423d35a-af86-411c-92e6-2ab40ba3d377 req-768add1e-b6b3-47d1-a86a-0846cef63d1d tempest-VolumesSnapshotsTestJSON-24727290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425" returned: 0 in 0.776s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-5423d35a-af86-411c-92e6-2ab40ba3d377 req-768add1e-b6b3-47d1-a86a-0846cef63d1d tempest-VolumesSnapshotsTestJSON-24727290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.3b2cec87-070b-4338-bcfe-be54d4aa60cc 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:20 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.3b2cec87-070b-4338-bcfe-be54d4aa60cc 1G Nov 05 03:51:20 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8afc8f77-e0ed-4569-bb7a-7c21ea02d4a4 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Acquiring lock "cinder-49e334df-60ec-480d-8488-cb6810bc4bbc-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8afc8f77-e0ed-4569-bb7a-7c21ea02d4a4 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Lock "cinder-49e334df-60ec-480d-8488-cb6810bc4bbc-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8afc8f77-e0ed-4569-bb7a-7c21ea02d4a4 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Acquiring lock "cinder-quobyte-49e334df-60ec-480d-8488-cb6810bc4bbc" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8afc8f77-e0ed-4569-bb7a-7c21ea02d4a4 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Lock "cinder-quobyte-49e334df-60ec-480d-8488-cb6810bc4bbc" acquired by "delete_volume" :: waited 0.033s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:20 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[105e990d-bb5a-4dcc-aa81-678c8f09ec0c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8afc8f77-e0ed-4569-bb7a-7c21ea02d4a4 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-49e334df-60ec-480d-8488-cb6810bc4bbc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:20 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-49e334df-60ec-480d-8488-cb6810bc4bbc Nov 05 03:51:20 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:21 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-5423d35a-af86-411c-92e6-2ab40ba3d377 req-768add1e-b6b3-47d1-a86a-0846cef63d1d tempest-VolumesSnapshotsTestJSON-24727290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.3b2cec87-070b-4338-bcfe-be54d4aa60cc 1G" returned: 0 in 0.738s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-5423d35a-af86-411c-92e6-2ab40ba3d377 req-768add1e-b6b3-47d1-a86a-0846cef63d1d tempest-VolumesSnapshotsTestJSON-24727290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.3b2cec87-070b-4338-bcfe-be54d4aa60cc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:21 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.3b2cec87-070b-4338-bcfe-be54d4aa60cc Nov 05 03:51:21 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:21 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8afc8f77-e0ed-4569-bb7a-7c21ea02d4a4 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-49e334df-60ec-480d-8488-cb6810bc4bbc" returned: 0 in 0.633s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8afc8f77-e0ed-4569-bb7a-7c21ea02d4a4 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-49e334df-60ec-480d-8488-cb6810bc4bbc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:21 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-49e334df-60ec-480d-8488-cb6810bc4bbc Nov 05 03:51:21 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:21 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-5423d35a-af86-411c-92e6-2ab40ba3d377 req-768add1e-b6b3-47d1-a86a-0846cef63d1d tempest-VolumesSnapshotsTestJSON-24727290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.3b2cec87-070b-4338-bcfe-be54d4aa60cc" returned: 0 in 0.697s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:21 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [req-5423d35a-af86-411c-92e6-2ab40ba3d377 req-768add1e-b6b3-47d1-a86a-0846cef63d1d tempest-VolumesSnapshotsTestJSON-24727290 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.3b2cec87-070b-4338-bcfe-be54d4aa60cc is being set with open permissions: ugo+rw Nov 05 03:51:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-5423d35a-af86-411c-92e6-2ab40ba3d377 req-768add1e-b6b3-47d1-a86a-0846cef63d1d tempest-VolumesSnapshotsTestJSON-24727290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.3b2cec87-070b-4338-bcfe-be54d4aa60cc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:21 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.3b2cec87-070b-4338-bcfe-be54d4aa60cc Nov 05 03:51:21 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:22 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8afc8f77-e0ed-4569-bb7a-7c21ea02d4a4 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-49e334df-60ec-480d-8488-cb6810bc4bbc" returned: 0 in 0.616s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8afc8f77-e0ed-4569-bb7a-7c21ea02d4a4 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Lock "cinder-quobyte-49e334df-60ec-480d-8488-cb6810bc4bbc" released by "delete_volume" :: held 1.332s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:22 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-8afc8f77-e0ed-4569-bb7a-7c21ea02d4a4 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Created reservations ['c4b2c041-eacf-4621-993a-32fc67c1a4e7', 'e1d0c610-5c95-4a68-9399-c05d620b3e19', 'b62ae47e-3861-4f60-8a67-227aa89ea9fc', '99242bb8-4002-4551-b531-4311dd57caae'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:22 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-5423d35a-af86-411c-92e6-2ab40ba3d377 req-768add1e-b6b3-47d1-a86a-0846cef63d1d tempest-VolumesSnapshotsTestJSON-24727290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.3b2cec87-070b-4338-bcfe-be54d4aa60cc" returned: 0 in 0.430s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8afc8f77-e0ed-4569-bb7a-7c21ea02d4a4 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8afc8f77-e0ed-4569-bb7a-7c21ea02d4a4 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8afc8f77-e0ed-4569-bb7a-7c21ea02d4a4 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8afc8f77-e0ed-4569-bb7a-7c21ea02d4a4 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8afc8f77-e0ed-4569-bb7a-7c21ea02d4a4 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8afc8f77-e0ed-4569-bb7a-7c21ea02d4a4 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-5423d35a-af86-411c-92e6-2ab40ba3d377 req-768add1e-b6b3-47d1-a86a-0846cef63d1d tempest-VolumesSnapshotsTestJSON-24727290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:22 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:51:22 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:22 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.info Nov 05 03:51:22 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:22 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-5423d35a-af86-411c-92e6-2ab40ba3d377 req-768add1e-b6b3-47d1-a86a-0846cef63d1d tempest-VolumesSnapshotsTestJSON-24727290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.info" returned: 0 in 0.418s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:22 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [req-5423d35a-af86-411c-92e6-2ab40ba3d377 req-768add1e-b6b3-47d1-a86a-0846cef63d1d tempest-VolumesSnapshotsTestJSON-24727290 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.info is being set with open permissions: ugo+rw Nov 05 03:51:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-5423d35a-af86-411c-92e6-2ab40ba3d377 req-768add1e-b6b3-47d1-a86a-0846cef63d1d tempest-VolumesSnapshotsTestJSON-24727290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:22 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8afc8f77-e0ed-4569-bb7a-7c21ea02d4a4 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.508s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:22 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-8afc8f77-e0ed-4569-bb7a-7c21ea02d4a4 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:51:22 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-8afc8f77-e0ed-4569-bb7a-7c21ea02d4a4 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Deleted volume successfully. Nov 05 03:51:22 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.info Nov 05 03:51:22 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8afc8f77-e0ed-4569-bb7a-7c21ea02d4a4 tempest-TestServerVolumeAttachScenarioOldVersion-106963543 None] Lock "cinder-49e334df-60ec-480d-8488-cb6810bc4bbc-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:23 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-5423d35a-af86-411c-92e6-2ab40ba3d377 req-768add1e-b6b3-47d1-a86a-0846cef63d1d tempest-VolumesSnapshotsTestJSON-24727290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.info" returned: 0 in 0.614s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-5423d35a-af86-411c-92e6-2ab40ba3d377 req-768add1e-b6b3-47d1-a86a-0846cef63d1d tempest-VolumesSnapshotsTestJSON-24727290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.924s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:23 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-5423d35a-af86-411c-92e6-2ab40ba3d377 req-768add1e-b6b3-47d1-a86a-0846cef63d1d tempest-VolumesSnapshotsTestJSON-24727290 None] Create snapshot completed successfully Nov 05 03:51:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] Acquiring lock "cinder-3b2cec87-070b-4338-bcfe-be54d4aa60cc-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] Lock "cinder-3b2cec87-070b-4338-bcfe-be54d4aa60cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] Acquiring lock "cinder-quobyte-e1177f9b-3ea7-4cca-be4b-f9fdecc00425" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] Lock "cinder-quobyte-e1177f9b-3ea7-4cca-be4b-f9fdecc00425" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] Acquiring lock "cinder-quobyte-3b2cec87-070b-4338-bcfe-be54d4aa60cc" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] Lock "cinder-quobyte-3b2cec87-070b-4338-bcfe-be54d4aa60cc" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:24 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] Deleting offline snapshot 3b2cec87-070b-4338-bcfe-be54d4aa60cc of volume e1177f9b-3ea7-4cca-be4b-f9fdecc00425 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:51:24 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] snapshot_file for this snap is: volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.3b2cec87-070b-4338-bcfe-be54d4aa60cc {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:51:24 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[9467c990-bc6c-4db6-961f-49c0131569e1]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.3b2cec87-070b-4338-bcfe-be54d4aa60cc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:24 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Flow 'volume_create_manager' (340e82c0-71c7-4d0e-8b66-607b8b9d2efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:25 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.3b2cec87-070b-4338-bcfe-be54d4aa60cc Nov 05 03:51:25 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d30a027-5dfc-4d67-8b29-269d8889fce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d30a027-5dfc-4d67-8b29-269d8889fce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-774779890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488630f2-dce5-4378-aed3-93f740b90768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c90ffd7d344cfbaec12659b4f59d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:25Z,use_quota=True,user_id='1dc2f67fdb364ac4a87814024585eea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49359acb-aada-4209-adeb-9287b3792075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49359acb-aada-4209-adeb-9287b3792075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d7e61e-e352-4bee-aa34-3a80abf7d9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d7e61e-e352-4bee-aa34-3a80abf7d9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488630f2-dce5-4378-aed3-93f740b90768', 'volume_name': 'volume-488630f2-dce5-4378-aed3-93f740b90768', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c617fc-674b-4ab9-bc9b-9fb4b7982a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c617fc-674b-4ab9-bc9b-9fb4b7982a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c294f9-f072-4bc6-8b4a-e3ca2bfec339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:25 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Volume 488630f2-dce5-4378-aed3-93f740b90768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488630f2-dce5-4378-aed3-93f740b90768', 'volume_size': 1} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-774779890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488630f2-dce5-4378-aed3-93f740b90768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c90ffd7d344cfbaec12659b4f59d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:25Z,use_quota=True,user_id='1dc2f67fdb364ac4a87814024585eea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Creating volume 488630f2-dce5-4378-aed3-93f740b90768 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:51:25 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-488630f2-dce5-4378-aed3-93f740b90768 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:25 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-488630f2-dce5-4378-aed3-93f740b90768 1073741824 Nov 05 03:51:25 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:25 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.3b2cec87-070b-4338-bcfe-be54d4aa60cc" returned: 0 in 0.840s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[db98f620-0d00-4f95-a84e-91e4ab89a768]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Flow 'volume_create_manager' (a0661b33-b26e-4b9f-b4f5-ebbf7cbb34ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50712faf-7969-4c44-b9b6-9a47207180a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50712faf-7969-4c44-b9b6-9a47207180a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1584018997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d14b0e-5d74-4748-aa3b-46397b6d869e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7b53e404cd45c88be1091ba91cbbc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:26Z,use_quota=True,user_id='4d61ed242f8248b3b612ccb80b4e3f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9120bcb-298e-4547-99dd-0713881cd163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9120bcb-298e-4547-99dd-0713881cd163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a8e7f1-8f04-4a4b-b315-ecfdfaa7f6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:26 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a8e7f1-8f04-4a4b-b315-ecfdfaa7f6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47d14b0e-5d74-4748-aa3b-46397b6d869e', 'volume_name': 'volume-47d14b0e-5d74-4748-aa3b-46397b6d869e', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:26 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d61afc0-6a00-4055-83d1-3092325236ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:26 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d61afc0-6a00-4055-83d1-3092325236ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:26 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fd8b3f-af4b-4071-a7d4-3c5a98b6258b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:26 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Volume 47d14b0e-5d74-4748-aa3b-46397b6d869e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47d14b0e-5d74-4748-aa3b-46397b6d869e', 'volume_size': 1} Nov 05 03:51:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:26 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425 Nov 05 03:51:26 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:26 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-488630f2-dce5-4378-aed3-93f740b90768 1073741824" returned: 0 in 0.951s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-488630f2-dce5-4378-aed3-93f740b90768 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:26 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-488630f2-dce5-4378-aed3-93f740b90768 Nov 05 03:51:26 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:26 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425" returned: 0 in 0.802s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.3b2cec87-070b-4338-bcfe-be54d4aa60cc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:26 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.3b2cec87-070b-4338-bcfe-be54d4aa60cc Nov 05 03:51:26 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:26 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-488630f2-dce5-4378-aed3-93f740b90768" returned: 0 in 0.665s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:51:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.913s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1584018997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d14b0e-5d74-4748-aa3b-46397b6d869e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7b53e404cd45c88be1091ba91cbbc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:26Z,use_quota=True,user_id='4d61ed242f8248b3b612ccb80b4e3f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Creating volume 47d14b0e-5d74-4748-aa3b-46397b6d869e {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:27 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:51:27 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.3b2cec87-070b-4338-bcfe-be54d4aa60cc" returned: 0 in 0.560s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.3b2cec87-070b-4338-bcfe-be54d4aa60cc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:27 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e 1073741824 Nov 05 03:51:27 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c294f9-f072-4bc6-8b4a-e3ca2bfec339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488630f2-dce5-4378-aed3-93f740b90768', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:27 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.3b2cec87-070b-4338-bcfe-be54d4aa60cc Nov 05 03:51:27 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63a941f-8f71-4a62-a2cb-9cdcd8be7d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:27 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Volume volume-488630f2-dce5-4378-aed3-93f740b90768 (488630f2-dce5-4378-aed3-93f740b90768): created successfully Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63a941f-8f71-4a62-a2cb-9cdcd8be7d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Flow 'volume_create_manager' (340e82c0-71c7-4d0e-8b66-607b8b9d2efa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:27 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5e564816-a054-4c28-8c77-a39951ddd9e5 tempest-VolumesActionsTest-802655299 None] Created volume successfully. Nov 05 03:51:27 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425.3b2cec87-070b-4338-bcfe-be54d4aa60cc" returned: 0 in 0.458s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] Lock "cinder-quobyte-3b2cec87-070b-4338-bcfe-be54d4aa60cc" released by "_delete_snapshot" :: held 2.901s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] Lock "cinder-quobyte-e1177f9b-3ea7-4cca-be4b-f9fdecc00425" released by "delete_snapshot" :: held 2.938s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG cinder.quota [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] Created reservations ['7e5b23e0-49f9-4c04-bc32-b2dc41ab88e4', '9c8a0d8a-165c-4950-bbd7-fb4a82fead7d', 'd18c1c2b-6abf-45df-9f64-9342c9b65813', 'aff92ee8-b834-47f0-ac4d-03980be649f0'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:27 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e 1073741824" returned: 0 in 0.706s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:27 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] Delete snapshot completed successfully. Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-ce3d1e5b-dbdf-4db8-af95-76ee33d11cc5 req-79df2d77-a3f3-485a-af2b-0aa626e4a76c tempest-VolumesSnapshotsTestJSON-24727290 None] Lock "cinder-3b2cec87-070b-4338-bcfe-be54d4aa60cc-delete_snapshot" released by "delete_snapshot" :: held 3.132s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:27 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e Nov 05 03:51:27 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:28 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e" returned: 0 in 0.248s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:28 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:51:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fd8b3f-af4b-4071-a7d4-3c5a98b6258b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47d14b0e-5d74-4748-aa3b-46397b6d869e', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81d71b5-1ded-481c-a438-4c41c364582c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:28 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Volume volume-47d14b0e-5d74-4748-aa3b-46397b6d869e (47d14b0e-5d74-4748-aa3b-46397b6d869e): created successfully Nov 05 03:51:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81d71b5-1ded-481c-a438-4c41c364582c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Flow 'volume_create_manager' (a0661b33-b26e-4b9f-b4f5-ebbf7cbb34ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:28 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-805be977-1670-4d13-b5be-a3d29431f190 tempest-SnapshotDependencyTests-867979575 None] Created volume successfully. Nov 05 03:51:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bef36f41-d3ed-4394-afe5-bb794a9c91d6 tempest-VolumesActionsTest-802655299 None] Acquiring lock "cinder-488630f2-dce5-4378-aed3-93f740b90768" by "attach_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bef36f41-d3ed-4394-afe5-bb794a9c91d6 tempest-VolumesActionsTest-802655299 None] Lock "cinder-488630f2-dce5-4378-aed3-93f740b90768" acquired by "attach_volume" :: waited 0.025s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-63c8c513-100d-47b8-a32c-303158f94ae4 req-12d0344f-e7ce-48e4-a310-065db0cf77f9 tempest-VolumesSnapshotsTestJSON-24727290 None] Acquiring lock "cinder-e1177f9b-3ea7-4cca-be4b-f9fdecc00425-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-63c8c513-100d-47b8-a32c-303158f94ae4 req-12d0344f-e7ce-48e4-a310-065db0cf77f9 tempest-VolumesSnapshotsTestJSON-24727290 None] Lock "cinder-e1177f9b-3ea7-4cca-be4b-f9fdecc00425-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:28 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-bef36f41-d3ed-4394-afe5-bb794a9c91d6 tempest-VolumesActionsTest-802655299 None] Attaching volume 488630f2-dce5-4378-aed3-93f740b90768 to instance f86c58b2-9f1d-458e-be81-7eb29d498c4d at mountpoint /dev/vdb on host None. Nov 05 03:51:28 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-bef36f41-d3ed-4394-afe5-bb794a9c91d6 tempest-VolumesActionsTest-802655299 None] Attach volume completed successfully. Nov 05 03:51:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bef36f41-d3ed-4394-afe5-bb794a9c91d6 tempest-VolumesActionsTest-802655299 None] Lock "cinder-488630f2-dce5-4378-aed3-93f740b90768" released by "attach_volume" :: held 0.158s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-63c8c513-100d-47b8-a32c-303158f94ae4 req-12d0344f-e7ce-48e4-a310-065db0cf77f9 tempest-VolumesSnapshotsTestJSON-24727290 None] Acquiring lock "cinder-quobyte-e1177f9b-3ea7-4cca-be4b-f9fdecc00425" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-63c8c513-100d-47b8-a32c-303158f94ae4 req-12d0344f-e7ce-48e4-a310-065db0cf77f9 tempest-VolumesSnapshotsTestJSON-24727290 None] Lock "cinder-quobyte-e1177f9b-3ea7-4cca-be4b-f9fdecc00425" acquired by "delete_volume" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:28 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca17115-5162-403d-978d-4c82cf7b0ef6]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-63c8c513-100d-47b8-a32c-303158f94ae4 req-12d0344f-e7ce-48e4-a310-065db0cf77f9 tempest-VolumesSnapshotsTestJSON-24727290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:28 devstack sudo[99072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425 Nov 05 03:51:28 devstack sudo[99072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:29 devstack sudo[99072]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-63c8c513-100d-47b8-a32c-303158f94ae4 req-12d0344f-e7ce-48e4-a310-065db0cf77f9 tempest-VolumesSnapshotsTestJSON-24727290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425" returned: 0 in 0.621s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-63c8c513-100d-47b8-a32c-303158f94ae4 req-12d0344f-e7ce-48e4-a310-065db0cf77f9 tempest-VolumesSnapshotsTestJSON-24727290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:29 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425 Nov 05 03:51:29 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-85ba1a1a-35e2-443a-b922-99f2d8523d22 tempest-SnapshotDependencyTests-867979575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-85ba1a1a-35e2-443a-b922-99f2d8523d22 tempest-SnapshotDependencyTests-867979575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-85ba1a1a-35e2-443a-b922-99f2d8523d22 tempest-SnapshotDependencyTests-867979575 None] Creating offline snapshot e18586e2-ac52-4c49-9c58-7f09065fc880 of volume 47d14b0e-5d74-4748-aa3b-46397b6d869e {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:51:29 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d147904-b2dd-4e3b-893c-edeb32ae40c8]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-85ba1a1a-35e2-443a-b922-99f2d8523d22 tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:29 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5f2a7e7d-d180-4be9-a44d-f011d007e926 tempest-VolumesActionsTest-685690765 None] Terminate volume connection completed successfully. Nov 05 03:51:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5f2a7e7d-d180-4be9-a44d-f011d007e926 tempest-VolumesActionsTest-685690765 None] Acquiring lock "cinder-488630f2-dce5-4378-aed3-93f740b90768-detach_volume" by "detach_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:29 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e Nov 05 03:51:29 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5f2a7e7d-d180-4be9-a44d-f011d007e926 tempest-VolumesActionsTest-685690765 None] Lock "cinder-488630f2-dce5-4378-aed3-93f740b90768-detach_volume" acquired by "detach_volume" :: waited 0.069s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:29 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5f2a7e7d-d180-4be9-a44d-f011d007e926 tempest-VolumesActionsTest-685690765 None] Detaching volume 488630f2-dce5-4378-aed3-93f740b90768 from instance f86c58b2-9f1d-458e-be81-7eb29d498c4d. Nov 05 03:51:29 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-63c8c513-100d-47b8-a32c-303158f94ae4 req-12d0344f-e7ce-48e4-a310-065db0cf77f9 tempest-VolumesSnapshotsTestJSON-24727290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1177f9b-3ea7-4cca-be4b-f9fdecc00425" returned: 0 in 0.769s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-63c8c513-100d-47b8-a32c-303158f94ae4 req-12d0344f-e7ce-48e4-a310-065db0cf77f9 tempest-VolumesSnapshotsTestJSON-24727290 None] Lock "cinder-quobyte-e1177f9b-3ea7-4cca-be4b-f9fdecc00425" released by "delete_volume" :: held 1.479s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:29 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5f2a7e7d-d180-4be9-a44d-f011d007e926 tempest-VolumesActionsTest-685690765 None] Detach volume completed successfully. Nov 05 03:51:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5f2a7e7d-d180-4be9-a44d-f011d007e926 tempest-VolumesActionsTest-685690765 None] Lock "cinder-488630f2-dce5-4378-aed3-93f740b90768-detach_volume" released by "detach_volume" :: held 0.176s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:29 devstack cinder-volume[87109]: DEBUG cinder.quota [req-63c8c513-100d-47b8-a32c-303158f94ae4 req-12d0344f-e7ce-48e4-a310-065db0cf77f9 tempest-VolumesSnapshotsTestJSON-24727290 None] Created reservations ['997c5a83-9046-4dd4-bbd3-2977bd3ee304', '500ded55-33bb-448d-90b6-5b33dd07f265', 'bbe0d4ad-f639-4d33-8187-870a704446d6', '7938b97a-c810-4ec5-96dc-c3a821d85bca'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:30 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-85ba1a1a-35e2-443a-b922-99f2d8523d22 tempest-SnapshotDependencyTests-867979575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e" returned: 0 in 0.684s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-85ba1a1a-35e2-443a-b922-99f2d8523d22 tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-63c8c513-100d-47b8-a32c-303158f94ae4 req-12d0344f-e7ce-48e4-a310-065db0cf77f9 tempest-VolumesSnapshotsTestJSON-24727290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-63c8c513-100d-47b8-a32c-303158f94ae4 req-12d0344f-e7ce-48e4-a310-065db0cf77f9 tempest-VolumesSnapshotsTestJSON-24727290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [req-63c8c513-100d-47b8-a32c-303158f94ae4 req-12d0344f-e7ce-48e4-a310-065db0cf77f9 tempest-VolumesSnapshotsTestJSON-24727290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [req-63c8c513-100d-47b8-a32c-303158f94ae4 req-12d0344f-e7ce-48e4-a310-065db0cf77f9 tempest-VolumesSnapshotsTestJSON-24727290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-63c8c513-100d-47b8-a32c-303158f94ae4 req-12d0344f-e7ce-48e4-a310-065db0cf77f9 tempest-VolumesSnapshotsTestJSON-24727290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-63c8c513-100d-47b8-a32c-303158f94ae4 req-12d0344f-e7ce-48e4-a310-065db0cf77f9 tempest-VolumesSnapshotsTestJSON-24727290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:30 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880 1G Nov 05 03:51:30 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-284c1c7e-cb33-49da-9e1b-e579ceef24f6 tempest-VolumesActionsTest-802655299 None] Acquiring lock "cinder-488630f2-dce5-4378-aed3-93f740b90768-detach_volume" by "detach_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-284c1c7e-cb33-49da-9e1b-e579ceef24f6 tempest-VolumesActionsTest-802655299 None] Lock "cinder-488630f2-dce5-4378-aed3-93f740b90768-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:30 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-284c1c7e-cb33-49da-9e1b-e579ceef24f6 tempest-VolumesActionsTest-802655299 None] Volume detach called, but volume not attached. Nov 05 03:51:30 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:51:30 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-284c1c7e-cb33-49da-9e1b-e579ceef24f6 tempest-VolumesActionsTest-802655299 None] Lock "cinder-488630f2-dce5-4378-aed3-93f740b90768-detach_volume" released by "detach_volume" :: held 0.022s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7d20c62f-d057-4933-ab40-62e10a3f1514 tempest-VolumesActionsTest-802655299 None] Acquiring lock "cinder-488630f2-dce5-4378-aed3-93f740b90768-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:30 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-63c8c513-100d-47b8-a32c-303158f94ae4 req-12d0344f-e7ce-48e4-a310-065db0cf77f9 tempest-VolumesSnapshotsTestJSON-24727290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.410s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG cinder.manager [req-63c8c513-100d-47b8-a32c-303158f94ae4 req-12d0344f-e7ce-48e4-a310-065db0cf77f9 tempest-VolumesSnapshotsTestJSON-24727290 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7d20c62f-d057-4933-ab40-62e10a3f1514 tempest-VolumesActionsTest-802655299 None] Lock "cinder-488630f2-dce5-4378-aed3-93f740b90768-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:30 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-63c8c513-100d-47b8-a32c-303158f94ae4 req-12d0344f-e7ce-48e4-a310-065db0cf77f9 tempest-VolumesSnapshotsTestJSON-24727290 None] Deleted volume successfully. Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-63c8c513-100d-47b8-a32c-303158f94ae4 req-12d0344f-e7ce-48e4-a310-065db0cf77f9 tempest-VolumesSnapshotsTestJSON-24727290 None] Lock "cinder-e1177f9b-3ea7-4cca-be4b-f9fdecc00425-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7d20c62f-d057-4933-ab40-62e10a3f1514 tempest-VolumesActionsTest-802655299 None] Acquiring lock "cinder-quobyte-488630f2-dce5-4378-aed3-93f740b90768" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7d20c62f-d057-4933-ab40-62e10a3f1514 tempest-VolumesActionsTest-802655299 None] Lock "cinder-quobyte-488630f2-dce5-4378-aed3-93f740b90768" acquired by "delete_volume" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0d7d57-7212-4a42-ba6f-bacc20105c2e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7d20c62f-d057-4933-ab40-62e10a3f1514 tempest-VolumesActionsTest-802655299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-488630f2-dce5-4378-aed3-93f740b90768 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:30 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-85ba1a1a-35e2-443a-b922-99f2d8523d22 tempest-SnapshotDependencyTests-867979575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880 1G" returned: 0 in 0.822s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-85ba1a1a-35e2-443a-b922-99f2d8523d22 tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d14b0e-5d74-4748-aa3b-46397b6d869e -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:31 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d14b0e-5d74-4748-aa3b-46397b6d869e -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880 Nov 05 03:51:31 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:31 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-488630f2-dce5-4378-aed3-93f740b90768 Nov 05 03:51:31 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:31 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7d20c62f-d057-4933-ab40-62e10a3f1514 tempest-VolumesActionsTest-802655299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-488630f2-dce5-4378-aed3-93f740b90768" returned: 0 in 0.657s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7d20c62f-d057-4933-ab40-62e10a3f1514 tempest-VolumesActionsTest-802655299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-488630f2-dce5-4378-aed3-93f740b90768 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:31 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-85ba1a1a-35e2-443a-b922-99f2d8523d22 tempest-SnapshotDependencyTests-867979575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d14b0e-5d74-4748-aa3b-46397b6d869e -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880" returned: 0 in 0.575s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:31 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-85ba1a1a-35e2-443a-b922-99f2d8523d22 tempest-SnapshotDependencyTests-867979575 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880 is being set with open permissions: ugo+rw Nov 05 03:51:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-85ba1a1a-35e2-443a-b922-99f2d8523d22 tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:31 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-488630f2-dce5-4378-aed3-93f740b90768 Nov 05 03:51:31 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:31 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880 Nov 05 03:51:31 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:32 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7d20c62f-d057-4933-ab40-62e10a3f1514 tempest-VolumesActionsTest-802655299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-488630f2-dce5-4378-aed3-93f740b90768" returned: 0 in 0.503s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7d20c62f-d057-4933-ab40-62e10a3f1514 tempest-VolumesActionsTest-802655299 None] Lock "cinder-quobyte-488630f2-dce5-4378-aed3-93f740b90768" released by "delete_volume" :: held 1.235s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:32 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-85ba1a1a-35e2-443a-b922-99f2d8523d22 tempest-SnapshotDependencyTests-867979575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880" returned: 0 in 0.515s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-85ba1a1a-35e2-443a-b922-99f2d8523d22 tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:32 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.info Nov 05 03:51:32 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:32 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-7d20c62f-d057-4933-ab40-62e10a3f1514 tempest-VolumesActionsTest-802655299 None] Created reservations ['2d43cf14-de35-4c13-b8cd-79d9dbeebf9d', '6bbd5e1e-42ef-41a9-bc61-04710eedcaf2', '08f4c770-6a87-44c3-ab39-8af8f50891dc', '35e8ce3d-c052-4288-ae5d-5af64e753939'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7d20c62f-d057-4933-ab40-62e10a3f1514 tempest-VolumesActionsTest-802655299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7d20c62f-d057-4933-ab40-62e10a3f1514 tempest-VolumesActionsTest-802655299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7d20c62f-d057-4933-ab40-62e10a3f1514 tempest-VolumesActionsTest-802655299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7d20c62f-d057-4933-ab40-62e10a3f1514 tempest-VolumesActionsTest-802655299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7d20c62f-d057-4933-ab40-62e10a3f1514 tempest-VolumesActionsTest-802655299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7d20c62f-d057-4933-ab40-62e10a3f1514 tempest-VolumesActionsTest-802655299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:32 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:51:32 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:32 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-85ba1a1a-35e2-443a-b922-99f2d8523d22 tempest-SnapshotDependencyTests-867979575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.info" returned: 0 in 0.583s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:32 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-85ba1a1a-35e2-443a-b922-99f2d8523d22 tempest-SnapshotDependencyTests-867979575 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.info is being set with open permissions: ugo+rw Nov 05 03:51:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-85ba1a1a-35e2-443a-b922-99f2d8523d22 tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:32 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.info Nov 05 03:51:32 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:32 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7d20c62f-d057-4933-ab40-62e10a3f1514 tempest-VolumesActionsTest-802655299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.482s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:32 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-7d20c62f-d057-4933-ab40-62e10a3f1514 tempest-VolumesActionsTest-802655299 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:51:32 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-7d20c62f-d057-4933-ab40-62e10a3f1514 tempest-VolumesActionsTest-802655299 None] Deleted volume successfully. Nov 05 03:51:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7d20c62f-d057-4933-ab40-62e10a3f1514 tempest-VolumesActionsTest-802655299 None] Lock "cinder-488630f2-dce5-4378-aed3-93f740b90768-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:33 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-85ba1a1a-35e2-443a-b922-99f2d8523d22 tempest-SnapshotDependencyTests-867979575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.info" returned: 0 in 0.455s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-85ba1a1a-35e2-443a-b922-99f2d8523d22 tempest-SnapshotDependencyTests-867979575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.846s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:33 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-85ba1a1a-35e2-443a-b922-99f2d8523d22 tempest-SnapshotDependencyTests-867979575 None] Create snapshot completed successfully Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Flow 'volume_create_manager' (b601f39f-6248-4aeb-817c-c4e8c81852f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddd8d26-3687-45da-9eba-23ddf9457eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddd8d26-3687-45da-9eba-23ddf9457eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea56360-48d2-42af-abb8-436857dfe8b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7b53e404cd45c88be1091ba91cbbc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e18586e2-ac52-4c49-9c58-7f09065fc880,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:35Z,use_quota=True,user_id='4d61ed242f8248b3b612ccb80b4e3f3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d125be8f-4872-4876-93d5-304a3c92a1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d125be8f-4872-4876-93d5-304a3c92a1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542d9e9e-9e7c-4ecd-a227-999325a3c284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542d9e9e-9e7c-4ecd-a227-999325a3c284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1ea56360-48d2-42af-abb8-436857dfe8b5', 'volume_name': 'volume-1ea56360-48d2-42af-abb8-436857dfe8b5', 'volume_size': 1, 'snapshot_id': 'e18586e2-ac52-4c49-9c58-7f09065fc880'}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f35d25-1b35-4c30-842b-bc6b75ea6c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f35d25-1b35-4c30-842b-bc6b75ea6c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a6c8ce-f88d-415c-a8d8-23b30f0ab451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:34 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Volume 1ea56360-48d2-42af-abb8-436857dfe8b5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1ea56360-48d2-42af-abb8-436857dfe8b5', 'volume_size': 1, 'snapshot_id': 'e18586e2-ac52-4c49-9c58-7f09065fc880'} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Acquiring lock "cinder-quobyte-e18586e2-ac52-4c49-9c58-7f09065fc880-1ea56360-48d2-42af-abb8-436857dfe8b5" by "_create_volume_from_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Lock "cinder-quobyte-e18586e2-ac52-4c49-9c58-7f09065fc880-1ea56360-48d2-42af-abb8-436857dfe8b5" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Creating volume 1ea56360-48d2-42af-abb8-436857dfe8b5 from snapshot e18586e2-ac52-4c49-9c58-7f09065fc880 {{(pid=87109) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Acquiring lock "cinder-quobyte-1ea56360-48d2-42af-abb8-436857dfe8b5" by "_copy_volume_from_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Lock "cinder-quobyte-1ea56360-48d2-42af-abb8-436857dfe8b5" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] snapshot: e18586e2-ac52-4c49-9c58-7f09065fc880, volume: 1ea56360-48d2-42af-abb8-436857dfe8b5, {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0cd958-41cc-4678-946e-4b21ee6cb5c9]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:34 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880 Nov 05 03:51:34 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:35 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880" returned: 0 in 0.559s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47d14b0e-5d74-4748-aa3b-46397b6d869e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:51:35 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[50627b27-ac7d-4022-afb0-36ec4a41cee5]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:35 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e Nov 05 03:51:35 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:35 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e" returned: 0 in 0.573s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 03:51:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Creating direct copy from snapshot {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 03:51:35 devstack cinder-volume[87109]: DEBUG cinder.utils [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Path /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ea56360-48d2-42af-abb8-436857dfe8b5 not found in is_blk_device check {{(pid=87109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 03:51:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ea56360-48d2-42af-abb8-436857dfe8b5 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:36 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ea56360-48d2-42af-abb8-436857dfe8b5 Nov 05 03:51:36 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97bca698-5cd1-4b3e-b91c-17c5f1410fb0 tempest-BackendsCapabilitiesAdminTestsJSON-915027895 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5555381774902, 'free_capacity_gb': 1773.5555381774902, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87109) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4851}} Nov 05 03:51:38 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:51:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Flow 'volume_create_manager' (473e063e-9c6b-474c-8578-1b8624fb344e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160b025a-2cb7-47dd-9d83-1bfbe3d00b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-826c0021-7786-45b9-945b-56fef3f44a92 tempest-BackendsCapabilitiesAdminTestsJSON-915027895 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5555381774902, 'free_capacity_gb': 1773.5555381774902, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87109) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4851}} Nov 05 03:51:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160b025a-2cb7-47dd-9d83-1bfbe3d00b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-225751322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827824f7-c5ec-4940-af00-64c03de9b901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c90ffd7d344cfbaec12659b4f59d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:38Z,use_quota=True,user_id='1dc2f67fdb364ac4a87814024585eea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2108f827-869e-4472-9fd8-550704b4da04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2108f827-869e-4472-9fd8-550704b4da04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b27437e1-e819-4551-8a1b-0c72bfa71a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b27437e1-e819-4551-8a1b-0c72bfa71a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '827824f7-c5ec-4940-af00-64c03de9b901', 'volume_name': 'volume-827824f7-c5ec-4940-af00-64c03de9b901', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee359f44-1168-4e12-bc88-3125a463f844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee359f44-1168-4e12-bc88-3125a463f844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3e2091-dba2-45e6-95e7-03c6880d0773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:38 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Volume 827824f7-c5ec-4940-af00-64c03de9b901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-827824f7-c5ec-4940-af00-64c03de9b901', 'volume_size': 1} Nov 05 03:51:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:44 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ea56360-48d2-42af-abb8-436857dfe8b5" returned: 0 in 8.241s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:44 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Image conversion details: src /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e, size 1024.00 MB, duration 8.24 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ea56360-48d2-42af-abb8-436857dfe8b5 {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:51:44 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Converted 1024.00 MB image at 124.24 MB/s Nov 05 03:51:44 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ea56360-48d2-42af-abb8-436857dfe8b5 is being set with open permissions: ugo+rw Nov 05 03:51:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ea56360-48d2-42af-abb8-436857dfe8b5 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:44 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ea56360-48d2-42af-abb8-436857dfe8b5 Nov 05 03:51:44 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:44 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ea56360-48d2-42af-abb8-436857dfe8b5" returned: 0 in 0.269s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Lock "cinder-quobyte-1ea56360-48d2-42af-abb8-436857dfe8b5" released by "_copy_volume_from_snapshot" :: held 9.761s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Lock "cinder-quobyte-e18586e2-ac52-4c49-9c58-7f09065fc880-1ea56360-48d2-42af-abb8-436857dfe8b5" released by "_create_volume_from_snapshot" :: held 9.840s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.866s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.115s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-225751322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827824f7-c5ec-4940-af00-64c03de9b901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c90ffd7d344cfbaec12659b4f59d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:38Z,use_quota=True,user_id='1dc2f67fdb364ac4a87814024585eea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:51:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Creating volume 827824f7-c5ec-4940-af00-64c03de9b901 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:51:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:51:44 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:51:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-827824f7-c5ec-4940-af00-64c03de9b901 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:44 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-827824f7-c5ec-4940-af00-64c03de9b901 1073741824 Nov 05 03:51:44 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6a6c8ce-f88d-415c-a8d8-23b30f0ab451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ea56360-48d2-42af-abb8-436857dfe8b5', 'volume_size': 1, 'snapshot_id': 'e18586e2-ac52-4c49-9c58-7f09065fc880'}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7ba7c0-cdc3-490e-81a9-b08fdf8fa5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:44 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Volume volume-1ea56360-48d2-42af-abb8-436857dfe8b5 (1ea56360-48d2-42af-abb8-436857dfe8b5): created successfully Nov 05 03:51:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b7ba7c0-cdc3-490e-81a9-b08fdf8fa5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Flow 'volume_create_manager' (b601f39f-6248-4aeb-817c-c4e8c81852f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:44 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-a8198e7b-7ec1-4de2-9255-b0eea379903e tempest-SnapshotDependencyTests-867979575 None] Created volume successfully. Nov 05 03:51:45 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-827824f7-c5ec-4940-af00-64c03de9b901 1073741824" returned: 0 in 0.607s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-827824f7-c5ec-4940-af00-64c03de9b901 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:45 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-827824f7-c5ec-4940-af00-64c03de9b901 Nov 05 03:51:45 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:45 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-827824f7-c5ec-4940-af00-64c03de9b901" returned: 0 in 0.281s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:45 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:51:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3e2091-dba2-45e6-95e7-03c6880d0773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-827824f7-c5ec-4940-af00-64c03de9b901', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48d7228-8fa7-40fd-b498-0dcf374e68fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:45 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Volume volume-827824f7-c5ec-4940-af00-64c03de9b901 (827824f7-c5ec-4940-af00-64c03de9b901): created successfully Nov 05 03:51:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48d7228-8fa7-40fd-b498-0dcf374e68fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Flow 'volume_create_manager' (473e063e-9c6b-474c-8578-1b8624fb344e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:45 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-97fe1a60-5513-4193-b6fd-452dc9e95c68 tempest-VolumesActionsTest-802655299 None] Created volume successfully. Nov 05 03:51:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] Acquiring lock "cinder-e18586e2-ac52-4c49-9c58-7f09065fc880-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] Lock "cinder-e18586e2-ac52-4c49-9c58-7f09065fc880-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] Acquiring lock "cinder-quobyte-47d14b0e-5d74-4748-aa3b-46397b6d869e" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] Lock "cinder-quobyte-47d14b0e-5d74-4748-aa3b-46397b6d869e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] Acquiring lock "cinder-quobyte-e18586e2-ac52-4c49-9c58-7f09065fc880" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] Lock "cinder-quobyte-e18586e2-ac52-4c49-9c58-7f09065fc880" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:45 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] Deleting offline snapshot e18586e2-ac52-4c49-9c58-7f09065fc880 of volume 47d14b0e-5d74-4748-aa3b-46397b6d869e {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:51:45 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] snapshot_file for this snap is: volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:51:45 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[915ef125-a1a6-4039-a7a5-c2d7ae4ab6eb]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0e483e21-8bca-4d5b-bd41-cdaa5ca078f1 tempest-VolumesActionsTest-685690765 None] Acquiring lock "cinder-827824f7-c5ec-4940-af00-64c03de9b901-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0e483e21-8bca-4d5b-bd41-cdaa5ca078f1 tempest-VolumesActionsTest-685690765 None] Lock "cinder-827824f7-c5ec-4940-af00-64c03de9b901-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:46 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880 Nov 05 03:51:46 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0e483e21-8bca-4d5b-bd41-cdaa5ca078f1 tempest-VolumesActionsTest-685690765 None] Acquiring lock "cinder-quobyte-827824f7-c5ec-4940-af00-64c03de9b901" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0e483e21-8bca-4d5b-bd41-cdaa5ca078f1 tempest-VolumesActionsTest-685690765 None] Lock "cinder-quobyte-827824f7-c5ec-4940-af00-64c03de9b901" acquired by "delete_volume" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:46 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f210e1-c3b9-4400-80dc-226ac5279707]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0e483e21-8bca-4d5b-bd41-cdaa5ca078f1 tempest-VolumesActionsTest-685690765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-827824f7-c5ec-4940-af00-64c03de9b901 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:46 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-827824f7-c5ec-4940-af00-64c03de9b901 Nov 05 03:51:46 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:46 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880" returned: 0 in 0.417s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47d14b0e-5d74-4748-aa3b-46397b6d869e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:51:46 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb157f84-f011-4511-b9f2-d5ac8588705b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:46 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e Nov 05 03:51:46 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:46 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0e483e21-8bca-4d5b-bd41-cdaa5ca078f1 tempest-VolumesActionsTest-685690765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-827824f7-c5ec-4940-af00-64c03de9b901" returned: 0 in 0.436s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0e483e21-8bca-4d5b-bd41-cdaa5ca078f1 tempest-VolumesActionsTest-685690765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-827824f7-c5ec-4940-af00-64c03de9b901 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:46 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-827824f7-c5ec-4940-af00-64c03de9b901 Nov 05 03:51:46 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:46 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0e483e21-8bca-4d5b-bd41-cdaa5ca078f1 tempest-VolumesActionsTest-685690765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-827824f7-c5ec-4940-af00-64c03de9b901" returned: 0 in 0.351s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:46 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e" returned: 0 in 0.621s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0e483e21-8bca-4d5b-bd41-cdaa5ca078f1 tempest-VolumesActionsTest-685690765 None] Lock "cinder-quobyte-827824f7-c5ec-4940-af00-64c03de9b901" released by "delete_volume" :: held 0.854s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:47 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880 Nov 05 03:51:47 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:47 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-0e483e21-8bca-4d5b-bd41-cdaa5ca078f1 tempest-VolumesActionsTest-685690765 None] Created reservations ['f0013a15-b881-441b-a78c-8525e9a07aa5', '35ae1d62-7f7f-45c1-9115-d7c1abc7340b', 'd1e35c9b-b121-489d-8d64-c8d7710a0b41', 'ea198f34-ea0f-489a-b823-013a785a221e'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0e483e21-8bca-4d5b-bd41-cdaa5ca078f1 tempest-VolumesActionsTest-685690765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0e483e21-8bca-4d5b-bd41-cdaa5ca078f1 tempest-VolumesActionsTest-685690765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0e483e21-8bca-4d5b-bd41-cdaa5ca078f1 tempest-VolumesActionsTest-685690765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0e483e21-8bca-4d5b-bd41-cdaa5ca078f1 tempest-VolumesActionsTest-685690765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0e483e21-8bca-4d5b-bd41-cdaa5ca078f1 tempest-VolumesActionsTest-685690765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0e483e21-8bca-4d5b-bd41-cdaa5ca078f1 tempest-VolumesActionsTest-685690765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:47 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:51:47 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:47 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880" returned: 0 in 0.485s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:47 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880 Nov 05 03:51:47 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:47 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0e483e21-8bca-4d5b-bd41-cdaa5ca078f1 tempest-VolumesActionsTest-685690765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.294s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:47 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-0e483e21-8bca-4d5b-bd41-cdaa5ca078f1 tempest-VolumesActionsTest-685690765 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:51:47 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-0e483e21-8bca-4d5b-bd41-cdaa5ca078f1 tempest-VolumesActionsTest-685690765 None] Deleted volume successfully. Nov 05 03:51:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0e483e21-8bca-4d5b-bd41-cdaa5ca078f1 tempest-VolumesActionsTest-685690765 None] Lock "cinder-827824f7-c5ec-4940-af00-64c03de9b901-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:47 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e.e18586e2-ac52-4c49-9c58-7f09065fc880" returned: 0 in 0.282s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] Lock "cinder-quobyte-e18586e2-ac52-4c49-9c58-7f09065fc880" released by "_delete_snapshot" :: held 1.962s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] Lock "cinder-quobyte-47d14b0e-5d74-4748-aa3b-46397b6d869e" released by "delete_snapshot" :: held 1.998s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:47 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-1af1935b-c99a-4551-8c40-4666334fbcff tempest-GroupsTest-578499395 None] Group tempest-Group1-762914399: creating Nov 05 03:51:47 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-1af1935b-c99a-4551-8c40-4666334fbcff tempest-GroupsTest-578499395 None] Group tempest-Group1-762914399: created successfully Nov 05 03:51:47 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-1af1935b-c99a-4551-8c40-4666334fbcff tempest-GroupsTest-578499395 None] Create group completed successfully. Nov 05 03:51:47 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] Created reservations ['8cde1fc8-2513-4068-bec9-8b6684fe8db3', '4f285f8a-4f4b-46ae-968a-ec6118a178dc', 'f854dd1d-75b9-41ac-bd2a-3759bbaf9626', 'c1f057f7-d7ce-414d-800d-4b56628e5279'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:47 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] Delete snapshot completed successfully. Nov 05 03:51:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-700c5058-aa97-4e1c-9bab-2a2c55856dcc tempest-SnapshotDependencyTests-867979575 None] Lock "cinder-e18586e2-ac52-4c49-9c58-7f09065fc880-delete_snapshot" released by "delete_snapshot" :: held 2.172s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Flow 'volume_create_manager' (a07c1c12-ec27-4853-90e1-69c687a6bba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c721f9-5346-49f7-b531-c4e8012d48dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7c721f9-5346-49f7-b531-c4e8012d48dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-879386243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e307d8-6169-417d-a74a-f16dd4c00e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c90ffd7d344cfbaec12659b4f59d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:49Z,use_quota=True,user_id='1dc2f67fdb364ac4a87814024585eea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5689b908-c7c3-4b38-85a8-4b42ca1355e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5689b908-c7c3-4b38-85a8-4b42ca1355e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b74358-2e1d-49bf-8139-97f6f3e5e616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87b74358-2e1d-49bf-8139-97f6f3e5e616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08e307d8-6169-417d-a74a-f16dd4c00e12', 'volume_name': 'volume-08e307d8-6169-417d-a74a-f16dd4c00e12', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a945c1a-d84c-422b-9b20-9582cca8ec32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a945c1a-d84c-422b-9b20-9582cca8ec32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0778f54-6deb-495b-8150-ff77ce52d7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:48 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Volume 08e307d8-6169-417d-a74a-f16dd4c00e12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08e307d8-6169-417d-a74a-f16dd4c00e12', 'volume_size': 1} Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-879386243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e307d8-6169-417d-a74a-f16dd4c00e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c90ffd7d344cfbaec12659b4f59d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:49Z,use_quota=True,user_id='1dc2f67fdb364ac4a87814024585eea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Creating volume 08e307d8-6169-417d-a74a-f16dd4c00e12 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:51:48 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:51:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-08e307d8-6169-417d-a74a-f16dd4c00e12 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:48 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-08e307d8-6169-417d-a74a-f16dd4c00e12 1073741824 Nov 05 03:51:48 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3e1b87c1-55bb-47fa-b049-62c3593c9cf3 tempest-SnapshotDependencyTests-867979575 None] Acquiring lock "cinder-47d14b0e-5d74-4748-aa3b-46397b6d869e-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3e1b87c1-55bb-47fa-b049-62c3593c9cf3 tempest-SnapshotDependencyTests-867979575 None] Lock "cinder-47d14b0e-5d74-4748-aa3b-46397b6d869e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:49 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-6efb3375-f059-4d2b-8262-45c59f73917c tempest-GroupsTest-578499395 None] Group tempest-Group2-662110998: creating Nov 05 03:51:49 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-6efb3375-f059-4d2b-8262-45c59f73917c tempest-GroupsTest-578499395 None] Group tempest-Group2-662110998: created successfully Nov 05 03:51:49 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-6efb3375-f059-4d2b-8262-45c59f73917c tempest-GroupsTest-578499395 None] Create group completed successfully. Nov 05 03:51:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3e1b87c1-55bb-47fa-b049-62c3593c9cf3 tempest-SnapshotDependencyTests-867979575 None] Acquiring lock "cinder-quobyte-47d14b0e-5d74-4748-aa3b-46397b6d869e" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3e1b87c1-55bb-47fa-b049-62c3593c9cf3 tempest-SnapshotDependencyTests-867979575 None] Lock "cinder-quobyte-47d14b0e-5d74-4748-aa3b-46397b6d869e" acquired by "delete_volume" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:49 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a42098-b53a-4b07-95e8-6e7ac5b705c7]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3e1b87c1-55bb-47fa-b049-62c3593c9cf3 tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:49 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e Nov 05 03:51:49 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:49 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-08e307d8-6169-417d-a74a-f16dd4c00e12 1073741824" returned: 0 in 0.513s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-08e307d8-6169-417d-a74a-f16dd4c00e12 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:49 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-08e307d8-6169-417d-a74a-f16dd4c00e12 Nov 05 03:51:49 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:49 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3e1b87c1-55bb-47fa-b049-62c3593c9cf3 tempest-SnapshotDependencyTests-867979575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e" returned: 0 in 0.422s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3e1b87c1-55bb-47fa-b049-62c3593c9cf3 tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:49 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e Nov 05 03:51:49 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:49 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-08e307d8-6169-417d-a74a-f16dd4c00e12" returned: 0 in 0.274s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:49 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:51:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:49 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0778f54-6deb-495b-8150-ff77ce52d7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08e307d8-6169-417d-a74a-f16dd4c00e12', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:49 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a30ddf5-2862-47ce-895c-71fcab866fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:49 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Volume volume-08e307d8-6169-417d-a74a-f16dd4c00e12 (08e307d8-6169-417d-a74a-f16dd4c00e12): created successfully Nov 05 03:51:49 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a30ddf5-2862-47ce-895c-71fcab866fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:49 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Flow 'volume_create_manager' (a07c1c12-ec27-4853-90e1-69c687a6bba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:49 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b5b07e89-660e-4ae0-b214-e8de11dc9473 tempest-VolumesActionsTest-802655299 None] Created volume successfully. Nov 05 03:51:49 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3e1b87c1-55bb-47fa-b049-62c3593c9cf3 tempest-SnapshotDependencyTests-867979575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-47d14b0e-5d74-4748-aa3b-46397b6d869e" returned: 0 in 0.283s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3e1b87c1-55bb-47fa-b049-62c3593c9cf3 tempest-SnapshotDependencyTests-867979575 None] Lock "cinder-quobyte-47d14b0e-5d74-4748-aa3b-46397b6d869e" released by "delete_volume" :: held 0.765s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:50 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-3e1b87c1-55bb-47fa-b049-62c3593c9cf3 tempest-SnapshotDependencyTests-867979575 None] Created reservations ['e7d46569-5a57-41a6-9d1a-63b36894927e', '3acbb353-0357-41ff-8cd3-ffbb8563f70c', '4a46e703-f98f-4d4b-ab0d-c499089734b5', '920a3a86-3891-4d82-8fdb-519459573a18'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3e1b87c1-55bb-47fa-b049-62c3593c9cf3 tempest-SnapshotDependencyTests-867979575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3e1b87c1-55bb-47fa-b049-62c3593c9cf3 tempest-SnapshotDependencyTests-867979575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3e1b87c1-55bb-47fa-b049-62c3593c9cf3 tempest-SnapshotDependencyTests-867979575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3e1b87c1-55bb-47fa-b049-62c3593c9cf3 tempest-SnapshotDependencyTests-867979575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3e1b87c1-55bb-47fa-b049-62c3593c9cf3 tempest-SnapshotDependencyTests-867979575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3e1b87c1-55bb-47fa-b049-62c3593c9cf3 tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:50 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:51:50 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-91e463d0-d548-4df2-b1dd-cdd387f2ee9a tempest-SnapshotDependencyTests-867979575 None] Acquiring lock "cinder-1ea56360-48d2-42af-abb8-436857dfe8b5-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-91e463d0-d548-4df2-b1dd-cdd387f2ee9a tempest-SnapshotDependencyTests-867979575 None] Lock "cinder-1ea56360-48d2-42af-abb8-436857dfe8b5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-91e463d0-d548-4df2-b1dd-cdd387f2ee9a tempest-SnapshotDependencyTests-867979575 None] Acquiring lock "cinder-quobyte-1ea56360-48d2-42af-abb8-436857dfe8b5" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-91e463d0-d548-4df2-b1dd-cdd387f2ee9a tempest-SnapshotDependencyTests-867979575 None] Lock "cinder-quobyte-1ea56360-48d2-42af-abb8-436857dfe8b5" acquired by "delete_volume" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:50 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e441cc5-6f12-478c-a873-4f630d8a133b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-91e463d0-d548-4df2-b1dd-cdd387f2ee9a tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ea56360-48d2-42af-abb8-436857dfe8b5 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:50 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3e1b87c1-55bb-47fa-b049-62c3593c9cf3 tempest-SnapshotDependencyTests-867979575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.358s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:50 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-3e1b87c1-55bb-47fa-b049-62c3593c9cf3 tempest-SnapshotDependencyTests-867979575 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:51:50 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-3e1b87c1-55bb-47fa-b049-62c3593c9cf3 tempest-SnapshotDependencyTests-867979575 None] Deleted volume successfully. Nov 05 03:51:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3e1b87c1-55bb-47fa-b049-62c3593c9cf3 tempest-SnapshotDependencyTests-867979575 None] Lock "cinder-47d14b0e-5d74-4748-aa3b-46397b6d869e-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:50 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ea56360-48d2-42af-abb8-436857dfe8b5 Nov 05 03:51:50 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:50 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:51:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Flow 'volume_create_manager' (7432eba5-a411-45df-9a1b-d8e244936ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10026578-719b-40c3-aa34-f056c9924fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10026578-719b-40c3-aa34-f056c9924fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-712843619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f09cbd60-068c-4847-a140-33e63c75b84a,host='devstack@QuobyteHD#QuobyteHD',id=337d31dc-8af1-4237-8108-0e6b3a47583b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678dbcf726f547e488568224172eed85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:51Z,use_quota=True,user_id='c0498af773e349d68c42c3a35c72aaa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0606c133-726a-4964-bf0e-fed13d01d38c),volume_type_id=0606c133-726a-4964-bf0e-fed13d01d38c)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d8e51d-f2b5-4fc2-a299-fb8b794139af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d8e51d-f2b5-4fc2-a299-fb8b794139af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c80d936-60ca-4d55-8e62-8d3fccbfc803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c80d936-60ca-4d55-8e62-8d3fccbfc803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '337d31dc-8af1-4237-8108-0e6b3a47583b', 'volume_name': 'volume-337d31dc-8af1-4237-8108-0e6b3a47583b', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6812db1-24ce-40bd-82d9-25e2d2418179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6812db1-24ce-40bd-82d9-25e2d2418179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ab1db1-3149-4d65-8a23-766a5ce341b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:51 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Volume 337d31dc-8af1-4237-8108-0e6b3a47583b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-337d31dc-8af1-4237-8108-0e6b3a47583b', 'volume_size': 1} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f09cbd60-068c-4847-a140-33e63c75b84a,created_at=2026-11-05T02:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-712843619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f09cbd60-068c-4847-a140-33e63c75b84a,host='devstack@QuobyteHD#QuobyteHD',id=337d31dc-8af1-4237-8108-0e6b3a47583b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678dbcf726f547e488568224172eed85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:51Z,use_quota=True,user_id='c0498af773e349d68c42c3a35c72aaa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0606c133-726a-4964-bf0e-fed13d01d38c),volume_type_id=0606c133-726a-4964-bf0e-fed13d01d38c)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Creating volume 337d31dc-8af1-4237-8108-0e6b3a47583b {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:51:51 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-337d31dc-8af1-4237-8108-0e6b3a47583b 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:51 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-91e463d0-d548-4df2-b1dd-cdd387f2ee9a tempest-SnapshotDependencyTests-867979575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ea56360-48d2-42af-abb8-436857dfe8b5" returned: 0 in 0.638s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-91e463d0-d548-4df2-b1dd-cdd387f2ee9a tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ea56360-48d2-42af-abb8-436857dfe8b5 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:51 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-337d31dc-8af1-4237-8108-0e6b3a47583b 1073741824 Nov 05 03:51:51 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:51 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ea56360-48d2-42af-abb8-436857dfe8b5 Nov 05 03:51:51 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8a64475d-b89b-49b2-8af8-91183e592209 tempest-VolumesActionsTest-685690765 None] Acquiring lock "cinder-08e307d8-6169-417d-a74a-f16dd4c00e12-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8a64475d-b89b-49b2-8af8-91183e592209 tempest-VolumesActionsTest-685690765 None] Lock "cinder-08e307d8-6169-417d-a74a-f16dd4c00e12-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8a64475d-b89b-49b2-8af8-91183e592209 tempest-VolumesActionsTest-685690765 None] Acquiring lock "cinder-quobyte-08e307d8-6169-417d-a74a-f16dd4c00e12" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8a64475d-b89b-49b2-8af8-91183e592209 tempest-VolumesActionsTest-685690765 None] Lock "cinder-quobyte-08e307d8-6169-417d-a74a-f16dd4c00e12" acquired by "delete_volume" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5917c39f-2f4c-42b2-8ce6-e46f2c2d6dbc]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a64475d-b89b-49b2-8af8-91183e592209 tempest-VolumesActionsTest-685690765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-08e307d8-6169-417d-a74a-f16dd4c00e12 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:51 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-08e307d8-6169-417d-a74a-f16dd4c00e12 Nov 05 03:51:51 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:51 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-91e463d0-d548-4df2-b1dd-cdd387f2ee9a tempest-SnapshotDependencyTests-867979575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ea56360-48d2-42af-abb8-436857dfe8b5" returned: 0 in 0.370s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-91e463d0-d548-4df2-b1dd-cdd387f2ee9a tempest-SnapshotDependencyTests-867979575 None] Lock "cinder-quobyte-1ea56360-48d2-42af-abb8-436857dfe8b5" released by "delete_volume" :: held 1.072s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-91e463d0-d548-4df2-b1dd-cdd387f2ee9a tempest-SnapshotDependencyTests-867979575 None] Created reservations ['116ad408-699d-44a2-8bd1-87ab70d27330', 'b51e2f94-95d6-41bb-beeb-5515d8f83f58', 'aa883cb3-0311-4925-bd4b-ddb6f0065804', 'b7bddadb-6cbb-45b4-81b1-61e32a3b19c1'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-91e463d0-d548-4df2-b1dd-cdd387f2ee9a tempest-SnapshotDependencyTests-867979575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-91e463d0-d548-4df2-b1dd-cdd387f2ee9a tempest-SnapshotDependencyTests-867979575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-91e463d0-d548-4df2-b1dd-cdd387f2ee9a tempest-SnapshotDependencyTests-867979575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:51 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-91e463d0-d548-4df2-b1dd-cdd387f2ee9a tempest-SnapshotDependencyTests-867979575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-91e463d0-d548-4df2-b1dd-cdd387f2ee9a tempest-SnapshotDependencyTests-867979575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-91e463d0-d548-4df2-b1dd-cdd387f2ee9a tempest-SnapshotDependencyTests-867979575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-337d31dc-8af1-4237-8108-0e6b3a47583b 1073741824" returned: 0 in 0.576s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:51 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:51:51 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-337d31dc-8af1-4237-8108-0e6b3a47583b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:51 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-337d31dc-8af1-4237-8108-0e6b3a47583b Nov 05 03:51:51 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:51 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a64475d-b89b-49b2-8af8-91183e592209 tempest-VolumesActionsTest-685690765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-08e307d8-6169-417d-a74a-f16dd4c00e12" returned: 0 in 0.443s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a64475d-b89b-49b2-8af8-91183e592209 tempest-VolumesActionsTest-685690765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-08e307d8-6169-417d-a74a-f16dd4c00e12 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:51 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-08e307d8-6169-417d-a74a-f16dd4c00e12 Nov 05 03:51:51 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:51 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-91e463d0-d548-4df2-b1dd-cdd387f2ee9a tempest-SnapshotDependencyTests-867979575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.292s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-91e463d0-d548-4df2-b1dd-cdd387f2ee9a tempest-SnapshotDependencyTests-867979575 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:51:51 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-91e463d0-d548-4df2-b1dd-cdd387f2ee9a tempest-SnapshotDependencyTests-867979575 None] Deleted volume successfully. Nov 05 03:51:51 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-337d31dc-8af1-4237-8108-0e6b3a47583b" returned: 0 in 0.273s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-91e463d0-d548-4df2-b1dd-cdd387f2ee9a tempest-SnapshotDependencyTests-867979575 None] Lock "cinder-1ea56360-48d2-42af-abb8-436857dfe8b5-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ab1db1-3149-4d65-8a23-766a5ce341b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-337d31dc-8af1-4237-8108-0e6b3a47583b', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1389833-35a4-4cc9-84d2-a0dd48b7cfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:52 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Volume volume-337d31dc-8af1-4237-8108-0e6b3a47583b (337d31dc-8af1-4237-8108-0e6b3a47583b): created successfully Nov 05 03:51:52 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1389833-35a4-4cc9-84d2-a0dd48b7cfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Flow 'volume_create_manager' (7432eba5-a411-45df-9a1b-d8e244936ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a64475d-b89b-49b2-8af8-91183e592209 tempest-VolumesActionsTest-685690765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-08e307d8-6169-417d-a74a-f16dd4c00e12" returned: 0 in 0.300s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8a64475d-b89b-49b2-8af8-91183e592209 tempest-VolumesActionsTest-685690765 None] Lock "cinder-quobyte-08e307d8-6169-417d-a74a-f16dd4c00e12" released by "delete_volume" :: held 0.808s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:52 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-3f10d1ed-775d-4698-9472-d3806fd51d2b tempest-GroupsTest-578499395 None] Created volume successfully. Nov 05 03:51:52 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-8a64475d-b89b-49b2-8af8-91183e592209 tempest-VolumesActionsTest-685690765 None] Created reservations ['627fbed6-36b1-4cf7-ab0b-fe2eae42c914', '8881c366-8bc9-4429-ad63-f19daf5852a1', 'afaa4756-4a01-4e39-9758-811c9c942089', '4202ab0d-8b7f-407a-949d-ffc5da6be6be'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8a64475d-b89b-49b2-8af8-91183e592209 tempest-VolumesActionsTest-685690765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8a64475d-b89b-49b2-8af8-91183e592209 tempest-VolumesActionsTest-685690765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8a64475d-b89b-49b2-8af8-91183e592209 tempest-VolumesActionsTest-685690765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8a64475d-b89b-49b2-8af8-91183e592209 tempest-VolumesActionsTest-685690765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8a64475d-b89b-49b2-8af8-91183e592209 tempest-VolumesActionsTest-685690765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a64475d-b89b-49b2-8af8-91183e592209 tempest-VolumesActionsTest-685690765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:52 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:51:52 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:52 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a64475d-b89b-49b2-8af8-91183e592209 tempest-VolumesActionsTest-685690765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.331s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:52 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-8a64475d-b89b-49b2-8af8-91183e592209 tempest-VolumesActionsTest-685690765 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:51:52 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-8a64475d-b89b-49b2-8af8-91183e592209 tempest-VolumesActionsTest-685690765 None] Deleted volume successfully. Nov 05 03:51:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8a64475d-b89b-49b2-8af8-91183e592209 tempest-VolumesActionsTest-685690765 None] Lock "cinder-08e307d8-6169-417d-a74a-f16dd4c00e12-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:52 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:51:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Flow 'volume_create_manager' (ec2bf353-39fa-455b-bad1-513ce227acda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d0cb3d-3979-4168-ae9b-7fa81717e608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d0cb3d-3979-4168-ae9b-7fa81717e608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-723901043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bad1ee-f89c-491e-8282-490e8862b947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c90ffd7d344cfbaec12659b4f59d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:53Z,use_quota=True,user_id='1dc2f67fdb364ac4a87814024585eea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d62282-1a4d-43e5-9499-f2c9311998f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d62282-1a4d-43e5-9499-f2c9311998f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65da0ec-3e31-4262-93fe-aafe8c5f07ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e65da0ec-3e31-4262-93fe-aafe8c5f07ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94bad1ee-f89c-491e-8282-490e8862b947', 'volume_name': 'volume-94bad1ee-f89c-491e-8282-490e8862b947', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4164120-e7ee-431f-945b-568bfa2cbde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4164120-e7ee-431f-945b-568bfa2cbde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3867cb-e5f6-491f-892f-18a042399d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:53 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Volume 94bad1ee-f89c-491e-8282-490e8862b947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94bad1ee-f89c-491e-8282-490e8862b947', 'volume_size': 1} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-723901043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bad1ee-f89c-491e-8282-490e8862b947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c90ffd7d344cfbaec12659b4f59d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:53Z,use_quota=True,user_id='1dc2f67fdb364ac4a87814024585eea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Creating volume 94bad1ee-f89c-491e-8282-490e8862b947 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:51:53 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94bad1ee-f89c-491e-8282-490e8862b947 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:53 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94bad1ee-f89c-491e-8282-490e8862b947 1073741824 Nov 05 03:51:53 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bc399fbf-8c98-47cc-b4a4-47191ee2139c tempest-GroupsTest-578499395 None] Acquiring lock "cinder-quobyte-337d31dc-8af1-4237-8108-0e6b3a47583b" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bc399fbf-8c98-47cc-b4a4-47191ee2139c tempest-GroupsTest-578499395 None] Lock "cinder-quobyte-337d31dc-8af1-4237-8108-0e6b3a47583b" acquired by "delete_volume" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35f5585-f7ee-4786-936a-e710dcf645ac]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bc399fbf-8c98-47cc-b4a4-47191ee2139c tempest-GroupsTest-578499395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-337d31dc-8af1-4237-8108-0e6b3a47583b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:53 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-337d31dc-8af1-4237-8108-0e6b3a47583b Nov 05 03:51:53 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:53 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94bad1ee-f89c-491e-8282-490e8862b947 1073741824" returned: 0 in 0.688s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94bad1ee-f89c-491e-8282-490e8862b947 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:53 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bc399fbf-8c98-47cc-b4a4-47191ee2139c tempest-GroupsTest-578499395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-337d31dc-8af1-4237-8108-0e6b3a47583b" returned: 0 in 0.480s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bc399fbf-8c98-47cc-b4a4-47191ee2139c tempest-GroupsTest-578499395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-337d31dc-8af1-4237-8108-0e6b3a47583b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:53 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94bad1ee-f89c-491e-8282-490e8862b947 Nov 05 03:51:53 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:53 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-337d31dc-8af1-4237-8108-0e6b3a47583b Nov 05 03:51:53 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:54 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94bad1ee-f89c-491e-8282-490e8862b947" returned: 0 in 0.334s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:51:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:54 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3867cb-e5f6-491f-892f-18a042399d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94bad1ee-f89c-491e-8282-490e8862b947', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe6a5e6-40fd-4a42-9b7d-1b78e58d5414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bc399fbf-8c98-47cc-b4a4-47191ee2139c tempest-GroupsTest-578499395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-337d31dc-8af1-4237-8108-0e6b3a47583b" returned: 0 in 0.346s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-bc399fbf-8c98-47cc-b4a4-47191ee2139c tempest-GroupsTest-578499395 None] Lock "cinder-quobyte-337d31dc-8af1-4237-8108-0e6b3a47583b" released by "delete_volume" :: held 0.906s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:54 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Volume volume-94bad1ee-f89c-491e-8282-490e8862b947 (94bad1ee-f89c-491e-8282-490e8862b947): created successfully Nov 05 03:51:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe6a5e6-40fd-4a42-9b7d-1b78e58d5414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Flow 'volume_create_manager' (ec2bf353-39fa-455b-bad1-513ce227acda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:54 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-c53208b4-dbaa-42e1-add5-d49e1c5cfe98 tempest-VolumesActionsTest-802655299 None] Created volume successfully. Nov 05 03:51:54 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-bc399fbf-8c98-47cc-b4a4-47191ee2139c tempest-GroupsTest-578499395 None] Created reservations ['7caf5919-3438-4a44-aa4f-3cdbcdcd123c'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:54 devstack cinder-volume[87109]: WARNING cinder.quota [None req-bc399fbf-8c98-47cc-b4a4-47191ee2139c tempest-GroupsTest-578499395 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-132719586 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-132719586, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:51:54 devstack cinder-volume[87109]: WARNING cinder.quota [None req-bc399fbf-8c98-47cc-b4a4-47191ee2139c tempest-GroupsTest-578499395 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-132719586 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-132719586, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:51:54 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-bc399fbf-8c98-47cc-b4a4-47191ee2139c tempest-GroupsTest-578499395 None] Created reservations ['b1a3db95-82aa-4a02-9586-acea6b81c18c', '7b68fd52-dbe1-4e57-a233-c0ba8e09abc4', 'fb03fc4e-f89d-4d19-97e3-a5c386c94ef8', '7d7cdae9-96ad-49fa-830e-07bdaf86b518'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bc399fbf-8c98-47cc-b4a4-47191ee2139c tempest-GroupsTest-578499395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bc399fbf-8c98-47cc-b4a4-47191ee2139c tempest-GroupsTest-578499395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-bc399fbf-8c98-47cc-b4a4-47191ee2139c tempest-GroupsTest-578499395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-bc399fbf-8c98-47cc-b4a4-47191ee2139c tempest-GroupsTest-578499395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bc399fbf-8c98-47cc-b4a4-47191ee2139c tempest-GroupsTest-578499395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bc399fbf-8c98-47cc-b4a4-47191ee2139c tempest-GroupsTest-578499395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:54 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:51:54 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:54 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bc399fbf-8c98-47cc-b4a4-47191ee2139c tempest-GroupsTest-578499395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.254s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:54 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-bc399fbf-8c98-47cc-b4a4-47191ee2139c tempest-GroupsTest-578499395 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:51:54 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-bc399fbf-8c98-47cc-b4a4-47191ee2139c tempest-GroupsTest-578499395 None] Delete group completed successfully. Nov 05 03:51:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-81feb27f-47e3-4eca-b831-10b5aebe2f84 tempest-VolumesActionsTest-685690765 None] Acquiring lock "cinder-94bad1ee-f89c-491e-8282-490e8862b947-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-81feb27f-47e3-4eca-b831-10b5aebe2f84 tempest-VolumesActionsTest-685690765 None] Lock "cinder-94bad1ee-f89c-491e-8282-490e8862b947-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-81feb27f-47e3-4eca-b831-10b5aebe2f84 tempest-VolumesActionsTest-685690765 None] Acquiring lock "cinder-quobyte-94bad1ee-f89c-491e-8282-490e8862b947" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:51:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-81feb27f-47e3-4eca-b831-10b5aebe2f84 tempest-VolumesActionsTest-685690765 None] Lock "cinder-quobyte-94bad1ee-f89c-491e-8282-490e8862b947" acquired by "delete_volume" :: waited 0.018s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:51:55 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68f7525-16b1-4770-83cd-b640ee21501b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:51:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-81feb27f-47e3-4eca-b831-10b5aebe2f84 tempest-VolumesActionsTest-685690765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94bad1ee-f89c-491e-8282-490e8862b947 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:55 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94bad1ee-f89c-491e-8282-490e8862b947 Nov 05 03:51:55 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:55 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-514ccbf5-e738-48bc-bfea-7fe70f63fb1b tempest-GroupsTest-578499395 None] Created reservations ['a344f0b7-3837-49e3-8f09-908eb648d5f3'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-514ccbf5-e738-48bc-bfea-7fe70f63fb1b tempest-GroupsTest-578499395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-514ccbf5-e738-48bc-bfea-7fe70f63fb1b tempest-GroupsTest-578499395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-514ccbf5-e738-48bc-bfea-7fe70f63fb1b tempest-GroupsTest-578499395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-514ccbf5-e738-48bc-bfea-7fe70f63fb1b tempest-GroupsTest-578499395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-514ccbf5-e738-48bc-bfea-7fe70f63fb1b tempest-GroupsTest-578499395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-514ccbf5-e738-48bc-bfea-7fe70f63fb1b tempest-GroupsTest-578499395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:55 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:51:55 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:56 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-81feb27f-47e3-4eca-b831-10b5aebe2f84 tempest-VolumesActionsTest-685690765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94bad1ee-f89c-491e-8282-490e8862b947" returned: 0 in 0.592s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-81feb27f-47e3-4eca-b831-10b5aebe2f84 tempest-VolumesActionsTest-685690765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94bad1ee-f89c-491e-8282-490e8862b947 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:56 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94bad1ee-f89c-491e-8282-490e8862b947 Nov 05 03:51:56 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:56 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-514ccbf5-e738-48bc-bfea-7fe70f63fb1b tempest-GroupsTest-578499395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.317s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:56 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-514ccbf5-e738-48bc-bfea-7fe70f63fb1b tempest-GroupsTest-578499395 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:51:56 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-514ccbf5-e738-48bc-bfea-7fe70f63fb1b tempest-GroupsTest-578499395 None] Delete group completed successfully. Nov 05 03:51:56 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-81feb27f-47e3-4eca-b831-10b5aebe2f84 tempest-VolumesActionsTest-685690765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94bad1ee-f89c-491e-8282-490e8862b947" returned: 0 in 0.370s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-81feb27f-47e3-4eca-b831-10b5aebe2f84 tempest-VolumesActionsTest-685690765 None] Lock "cinder-quobyte-94bad1ee-f89c-491e-8282-490e8862b947" released by "delete_volume" :: held 1.024s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:56 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-81feb27f-47e3-4eca-b831-10b5aebe2f84 tempest-VolumesActionsTest-685690765 None] Created reservations ['5c212018-361a-4287-b595-e22739e40d9e', 'e86921fa-102d-4245-813b-f43f32155ad0', '34f03221-c4cf-4950-9797-ccc34a07d12a', '78654e79-e41f-4c39-b57e-e21d5836a358'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:51:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-81feb27f-47e3-4eca-b831-10b5aebe2f84 tempest-VolumesActionsTest-685690765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-81feb27f-47e3-4eca-b831-10b5aebe2f84 tempest-VolumesActionsTest-685690765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-81feb27f-47e3-4eca-b831-10b5aebe2f84 tempest-VolumesActionsTest-685690765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-81feb27f-47e3-4eca-b831-10b5aebe2f84 tempest-VolumesActionsTest-685690765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-81feb27f-47e3-4eca-b831-10b5aebe2f84 tempest-VolumesActionsTest-685690765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-81feb27f-47e3-4eca-b831-10b5aebe2f84 tempest-VolumesActionsTest-685690765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:56 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:51:56 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:56 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-81feb27f-47e3-4eca-b831-10b5aebe2f84 tempest-VolumesActionsTest-685690765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.278s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:56 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-81feb27f-47e3-4eca-b831-10b5aebe2f84 tempest-VolumesActionsTest-685690765 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:51:56 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-81feb27f-47e3-4eca-b831-10b5aebe2f84 tempest-VolumesActionsTest-685690765 None] Deleted volume successfully. Nov 05 03:51:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-81feb27f-47e3-4eca-b831-10b5aebe2f84 tempest-VolumesActionsTest-685690765 None] Lock "cinder-94bad1ee-f89c-491e-8282-490e8862b947-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:51:57 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5390376f-b7ac-49b1-a56d-b9a778ad4b02 tempest-GroupsTest-578499395 None] Group tempest-GroupsTest-Group-1552842406: creating Nov 05 03:51:57 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5390376f-b7ac-49b1-a56d-b9a778ad4b02 tempest-GroupsTest-578499395 None] Group tempest-GroupsTest-Group-1552842406: created successfully Nov 05 03:51:57 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5390376f-b7ac-49b1-a56d-b9a778ad4b02 tempest-GroupsTest-578499395 None] Create group completed successfully. Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Flow 'volume_create_manager' (3dfbc844-ad1c-4a66-b16d-1b865f8ed415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac07f1f-ec33-4deb-b9d6-bbbfbae04879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac07f1f-ec33-4deb-b9d6-bbbfbae04879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-448888727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dca4633-2041-4831-9126-0d282c065311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c90ffd7d344cfbaec12659b4f59d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:58Z,use_quota=True,user_id='1dc2f67fdb364ac4a87814024585eea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6c562b-6bed-4f51-9582-18ba82dd8cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6c562b-6bed-4f51-9582-18ba82dd8cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88ec435-2815-4f3e-98ef-a08576f3d864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88ec435-2815-4f3e-98ef-a08576f3d864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dca4633-2041-4831-9126-0d282c065311', 'volume_name': 'volume-1dca4633-2041-4831-9126-0d282c065311', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5e507e-4f37-4f96-b74d-db3203e375be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5e507e-4f37-4f96-b74d-db3203e375be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d38f0862-d0b2-4ad0-94d7-fed0c42750b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:58 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Volume 1dca4633-2041-4831-9126-0d282c065311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dca4633-2041-4831-9126-0d282c065311', 'volume_size': 1} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-448888727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dca4633-2041-4831-9126-0d282c065311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c90ffd7d344cfbaec12659b4f59d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:51:58Z,use_quota=True,user_id='1dc2f67fdb364ac4a87814024585eea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Creating volume 1dca4633-2041-4831-9126-0d282c065311 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:51:58 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dca4633-2041-4831-9126-0d282c065311 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:58 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dca4633-2041-4831-9126-0d282c065311 1073741824 Nov 05 03:51:58 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:58 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:51:58 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:58 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.342s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 28 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:51:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:51:59 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dca4633-2041-4831-9126-0d282c065311 1073741824" returned: 0 in 0.766s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dca4633-2041-4831-9126-0d282c065311 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:51:59 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dca4633-2041-4831-9126-0d282c065311 Nov 05 03:51:59 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:51:59 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Nov 05 03:51:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dca4633-2041-4831-9126-0d282c065311" returned: 0 in 0.486s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:51:59 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:51:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:51:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d38f0862-d0b2-4ad0-94d7-fed0c42750b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dca4633-2041-4831-9126-0d282c065311', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956f150b-fa7f-4347-bbee-6edbf30f4a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:59 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:51:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Flow 'volume_create_manager' (47dc4816-ed48-496a-b84e-29b5fa3de486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2237b9-1239-49f1-a836-13ebe2508b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:59 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Volume volume-1dca4633-2041-4831-9126-0d282c065311 (1dca4633-2041-4831-9126-0d282c065311): created successfully Nov 05 03:51:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956f150b-fa7f-4347-bbee-6edbf30f4a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Flow 'volume_create_manager' (3dfbc844-ad1c-4a66-b16d-1b865f8ed415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:51:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee2237b9-1239-49f1-a836-13ebe2508b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-978238470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c6c04b3-beb5-418a-9ed5-8ed6c1528344,host='devstack@QuobyteHD#QuobyteHD',id=ad79d92b-5d85-491f-b1f0-f6b1f581a1f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678dbcf726f547e488568224172eed85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:00Z,use_quota=True,user_id='c0498af773e349d68c42c3a35c72aaa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08e15892-103d-4568-8eff-a0886670d7b0),volume_type_id=08e15892-103d-4568-8eff-a0886670d7b0)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8ba639-6e05-41d5-8589-8563bcf07da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8ba639-6e05-41d5-8589-8563bcf07da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44e3063-408e-45c6-8981-7651cd70858f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44e3063-408e-45c6-8981-7651cd70858f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad79d92b-5d85-491f-b1f0-f6b1f581a1f8', 'volume_name': 'volume-ad79d92b-5d85-491f-b1f0-f6b1f581a1f8', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ca2513-402d-43e0-b834-70122fa00dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:51:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ca2513-402d-43e0-b834-70122fa00dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:51:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04d4015-ead3-4720-941a-84b82084fe88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:00 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Volume ad79d92b-5d85-491f-b1f0-f6b1f581a1f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad79d92b-5d85-491f-b1f0-f6b1f581a1f8', 'volume_size': 1} Nov 05 03:52:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8c6c04b3-beb5-418a-9ed5-8ed6c1528344,created_at=2026-11-05T02:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-978238470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c6c04b3-beb5-418a-9ed5-8ed6c1528344,host='devstack@QuobyteHD#QuobyteHD',id=ad79d92b-5d85-491f-b1f0-f6b1f581a1f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678dbcf726f547e488568224172eed85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:00Z,use_quota=True,user_id='c0498af773e349d68c42c3a35c72aaa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08e15892-103d-4568-8eff-a0886670d7b0),volume_type_id=08e15892-103d-4568-8eff-a0886670d7b0)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:52:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Creating volume ad79d92b-5d85-491f-b1f0-f6b1f581a1f8 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:52:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:52:00 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:52:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ad79d92b-5d85-491f-b1f0-f6b1f581a1f8 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:00 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-8796845c-187e-4105-8cab-230ccf5b3ead tempest-VolumesActionsTest-802655299 None] Created volume successfully. Nov 05 03:52:00 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ad79d92b-5d85-491f-b1f0-f6b1f581a1f8 1073741824 Nov 05 03:52:00 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:00 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ad79d92b-5d85-491f-b1f0-f6b1f581a1f8 1073741824" returned: 0 in 0.725s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7e576e48-7734-406f-8c6e-73b1a57fd0e7 tempest-VolumesActionsTest-685690765 None] Acquiring lock "cinder-1dca4633-2041-4831-9126-0d282c065311-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7e576e48-7734-406f-8c6e-73b1a57fd0e7 tempest-VolumesActionsTest-685690765 None] Lock "cinder-1dca4633-2041-4831-9126-0d282c065311-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ad79d92b-5d85-491f-b1f0-f6b1f581a1f8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:00 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ad79d92b-5d85-491f-b1f0-f6b1f581a1f8 Nov 05 03:52:00 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7e576e48-7734-406f-8c6e-73b1a57fd0e7 tempest-VolumesActionsTest-685690765 None] Acquiring lock "cinder-quobyte-1dca4633-2041-4831-9126-0d282c065311" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7e576e48-7734-406f-8c6e-73b1a57fd0e7 tempest-VolumesActionsTest-685690765 None] Lock "cinder-quobyte-1dca4633-2041-4831-9126-0d282c065311" acquired by "delete_volume" :: waited 0.020s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:00 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7b272e-edf6-4aa1-898b-adf4208cfb2d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7e576e48-7734-406f-8c6e-73b1a57fd0e7 tempest-VolumesActionsTest-685690765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dca4633-2041-4831-9126-0d282c065311 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:01 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dca4633-2041-4831-9126-0d282c065311 Nov 05 03:52:01 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:01 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ad79d92b-5d85-491f-b1f0-f6b1f581a1f8" returned: 0 in 0.412s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:52:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04d4015-ead3-4720-941a-84b82084fe88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad79d92b-5d85-491f-b1f0-f6b1f581a1f8', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f18420e9-c418-49a3-8c81-dacc1e56fabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:01 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Volume volume-ad79d92b-5d85-491f-b1f0-f6b1f581a1f8 (ad79d92b-5d85-491f-b1f0-f6b1f581a1f8): created successfully Nov 05 03:52:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f18420e9-c418-49a3-8c81-dacc1e56fabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Flow 'volume_create_manager' (47dc4816-ed48-496a-b84e-29b5fa3de486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:01 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-fc0ec8dd-7785-46c5-8be6-0e618c5bb51d tempest-GroupsTest-578499395 None] Created volume successfully. Nov 05 03:52:01 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7e576e48-7734-406f-8c6e-73b1a57fd0e7 tempest-VolumesActionsTest-685690765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dca4633-2041-4831-9126-0d282c065311" returned: 0 in 0.544s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7e576e48-7734-406f-8c6e-73b1a57fd0e7 tempest-VolumesActionsTest-685690765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dca4633-2041-4831-9126-0d282c065311 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:01 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dca4633-2041-4831-9126-0d282c065311 Nov 05 03:52:01 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:01 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7e576e48-7734-406f-8c6e-73b1a57fd0e7 tempest-VolumesActionsTest-685690765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dca4633-2041-4831-9126-0d282c065311" returned: 0 in 0.342s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7e576e48-7734-406f-8c6e-73b1a57fd0e7 tempest-VolumesActionsTest-685690765 None] Lock "cinder-quobyte-1dca4633-2041-4831-9126-0d282c065311" released by "delete_volume" :: held 0.949s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:01 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-7e576e48-7734-406f-8c6e-73b1a57fd0e7 tempest-VolumesActionsTest-685690765 None] Created reservations ['fc4c644d-2d4c-429f-80ed-effb486e94b6', 'c60ec0ea-6d10-47e1-ab94-2ae413b27f00', '6000e73b-ac5a-45e7-b926-4994806eb652', '407f964a-c1bf-43ba-9ebc-933e5517335e'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:52:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7e576e48-7734-406f-8c6e-73b1a57fd0e7 tempest-VolumesActionsTest-685690765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7e576e48-7734-406f-8c6e-73b1a57fd0e7 tempest-VolumesActionsTest-685690765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:02 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7e576e48-7734-406f-8c6e-73b1a57fd0e7 tempest-VolumesActionsTest-685690765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:02 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7e576e48-7734-406f-8c6e-73b1a57fd0e7 tempest-VolumesActionsTest-685690765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7e576e48-7734-406f-8c6e-73b1a57fd0e7 tempest-VolumesActionsTest-685690765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7e576e48-7734-406f-8c6e-73b1a57fd0e7 tempest-VolumesActionsTest-685690765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:02 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:52:02 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:02 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7e576e48-7734-406f-8c6e-73b1a57fd0e7 tempest-VolumesActionsTest-685690765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.333s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:02 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-7e576e48-7734-406f-8c6e-73b1a57fd0e7 tempest-VolumesActionsTest-685690765 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:52:02 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-7e576e48-7734-406f-8c6e-73b1a57fd0e7 tempest-VolumesActionsTest-685690765 None] Deleted volume successfully. Nov 05 03:52:02 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7e576e48-7734-406f-8c6e-73b1a57fd0e7 tempest-VolumesActionsTest-685690765 None] Lock "cinder-1dca4633-2041-4831-9126-0d282c065311-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Flow 'volume_create_manager' (bfce0a8f-18e0-4764-9bc6-fc8228ab5868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f4bb38-b0c4-4940-b0da-d729f7005683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f4bb38-b0c4-4940-b0da-d729f7005683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1724122211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c6c04b3-beb5-418a-9ed5-8ed6c1528344,host='devstack@QuobyteHD#QuobyteHD',id=3032f973-b64b-48f7-8187-59ea54a28c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678dbcf726f547e488568224172eed85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:03Z,use_quota=True,user_id='c0498af773e349d68c42c3a35c72aaa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08e15892-103d-4568-8eff-a0886670d7b0),volume_type_id=08e15892-103d-4568-8eff-a0886670d7b0)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd135fd4-cf30-43ba-8f59-c83b4c9bdf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd135fd4-cf30-43ba-8f59-c83b4c9bdf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2b2356-7738-45ca-a6b8-4a140b89937b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2b2356-7738-45ca-a6b8-4a140b89937b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3032f973-b64b-48f7-8187-59ea54a28c29', 'volume_name': 'volume-3032f973-b64b-48f7-8187-59ea54a28c29', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca7cf47-d151-4c2c-8136-eed457b1e9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca7cf47-d151-4c2c-8136-eed457b1e9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f6d37d-d8ba-4b81-943d-784f43b902a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:03 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Volume 3032f973-b64b-48f7-8187-59ea54a28c29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3032f973-b64b-48f7-8187-59ea54a28c29', 'volume_size': 1} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8c6c04b3-beb5-418a-9ed5-8ed6c1528344,created_at=2026-11-05T02:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1724122211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8c6c04b3-beb5-418a-9ed5-8ed6c1528344,host='devstack@QuobyteHD#QuobyteHD',id=3032f973-b64b-48f7-8187-59ea54a28c29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='678dbcf726f547e488568224172eed85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:03Z,use_quota=True,user_id='c0498af773e349d68c42c3a35c72aaa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08e15892-103d-4568-8eff-a0886670d7b0),volume_type_id=08e15892-103d-4568-8eff-a0886670d7b0)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Creating volume 3032f973-b64b-48f7-8187-59ea54a28c29 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:52:03 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3032f973-b64b-48f7-8187-59ea54a28c29 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:03 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3032f973-b64b-48f7-8187-59ea54a28c29 1073741824 Nov 05 03:52:03 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Flow 'volume_create_manager' (c5a0e3ef-d722-4af6-bce2-f6ea331be0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5bcc8f-d219-4880-9f74-8359cbd39973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5bcc8f-d219-4880-9f74-8359cbd39973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1371972924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c75db53c-a567-432e-b531-6173511f4ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c90ffd7d344cfbaec12659b4f59d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:04Z,use_quota=True,user_id='1dc2f67fdb364ac4a87814024585eea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a863e4b-96c6-43fb-b5e3-bbb0fefd81e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a863e4b-96c6-43fb-b5e3-bbb0fefd81e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d754ea6-0055-480b-b3b1-6e1d322852fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d754ea6-0055-480b-b3b1-6e1d322852fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c75db53c-a567-432e-b531-6173511f4ab3', 'volume_name': 'volume-c75db53c-a567-432e-b531-6173511f4ab3', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8203876-3b7b-4a4a-9e70-2a27da338226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8203876-3b7b-4a4a-9e70-2a27da338226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce26d443-cd7c-47b0-b6aa-8e7175ac28fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:04 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Volume c75db53c-a567-432e-b531-6173511f4ab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c75db53c-a567-432e-b531-6173511f4ab3', 'volume_size': 1} Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:04 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3032f973-b64b-48f7-8187-59ea54a28c29 1073741824" returned: 0 in 0.657s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3032f973-b64b-48f7-8187-59ea54a28c29 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:04 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3032f973-b64b-48f7-8187-59ea54a28c29 Nov 05 03:52:04 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:04 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3032f973-b64b-48f7-8187-59ea54a28c29" returned: 0 in 0.295s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.388s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1371972924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c75db53c-a567-432e-b531-6173511f4ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2c90ffd7d344cfbaec12659b4f59d75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:04Z,use_quota=True,user_id='1dc2f67fdb364ac4a87814024585eea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Creating volume c75db53c-a567-432e-b531-6173511f4ab3 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:52:04 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c75db53c-a567-432e-b531-6173511f4ab3 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f6d37d-d8ba-4b81-943d-784f43b902a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3032f973-b64b-48f7-8187-59ea54a28c29', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ded404-4f56-4f14-850e-0c47de537195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:04 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Volume volume-3032f973-b64b-48f7-8187-59ea54a28c29 (3032f973-b64b-48f7-8187-59ea54a28c29): created successfully Nov 05 03:52:04 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c75db53c-a567-432e-b531-6173511f4ab3 1073741824 Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ded404-4f56-4f14-850e-0c47de537195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:04 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Flow 'volume_create_manager' (bfce0a8f-18e0-4764-9bc6-fc8228ab5868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:04 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-4a13efce-ddd8-4197-b494-2e097dd0b407 tempest-GroupsTest-578499395 None] Created volume successfully. Nov 05 03:52:04 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c75db53c-a567-432e-b531-6173511f4ab3 1073741824" returned: 0 in 0.561s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c75db53c-a567-432e-b531-6173511f4ab3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:05 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c75db53c-a567-432e-b531-6173511f4ab3 Nov 05 03:52:05 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:05 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c75db53c-a567-432e-b531-6173511f4ab3" returned: 0 in 0.347s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:52:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce26d443-cd7c-47b0-b6aa-8e7175ac28fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c75db53c-a567-432e-b531-6173511f4ab3', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f3bba0-e783-468a-95d6-7fe57d5aeff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:05 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Volume volume-c75db53c-a567-432e-b531-6173511f4ab3 (c75db53c-a567-432e-b531-6173511f4ab3): created successfully Nov 05 03:52:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12f3bba0-e783-468a-95d6-7fe57d5aeff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Flow 'volume_create_manager' (c5a0e3ef-d722-4af6-bce2-f6ea331be0f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:05 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-6d12de60-1ea5-4b95-b11f-65bdeb84cf2c tempest-VolumesActionsTest-802655299 None] Created volume successfully. Nov 05 03:52:05 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-46be9326-dfd7-47a2-8ace-6adeec808b8a tempest-GroupsTest-578499395 None] Update group completed successfully. Nov 05 03:52:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-01bb86aa-2501-4e68-b3ba-0eea04a7965f tempest-VolumesActionsTest-802655299 None] Acquiring lock "cinder-c75db53c-a567-432e-b531-6173511f4ab3-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:07 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-01bb86aa-2501-4e68-b3ba-0eea04a7965f tempest-VolumesActionsTest-802655299 None] Lock "cinder-c75db53c-a567-432e-b531-6173511f4ab3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:07 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-01bb86aa-2501-4e68-b3ba-0eea04a7965f tempest-VolumesActionsTest-802655299 None] Acquiring lock "cinder-quobyte-c75db53c-a567-432e-b531-6173511f4ab3" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:07 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-01bb86aa-2501-4e68-b3ba-0eea04a7965f tempest-VolumesActionsTest-802655299 None] Lock "cinder-quobyte-c75db53c-a567-432e-b531-6173511f4ab3" acquired by "delete_volume" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:07 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[313ad6da-5097-4600-a77f-10da1548f576]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-01bb86aa-2501-4e68-b3ba-0eea04a7965f tempest-VolumesActionsTest-802655299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c75db53c-a567-432e-b531-6173511f4ab3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:07 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c75db53c-a567-432e-b531-6173511f4ab3 Nov 05 03:52:07 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:07 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-c601214a-a052-4c39-896f-870a096ab437 tempest-GroupsTest-578499395 None] Update group completed successfully. Nov 05 03:52:07 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-01bb86aa-2501-4e68-b3ba-0eea04a7965f tempest-VolumesActionsTest-802655299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c75db53c-a567-432e-b531-6173511f4ab3" returned: 0 in 0.493s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-01bb86aa-2501-4e68-b3ba-0eea04a7965f tempest-VolumesActionsTest-802655299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c75db53c-a567-432e-b531-6173511f4ab3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:07 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c75db53c-a567-432e-b531-6173511f4ab3 Nov 05 03:52:07 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:07 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-01bb86aa-2501-4e68-b3ba-0eea04a7965f tempest-VolumesActionsTest-802655299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c75db53c-a567-432e-b531-6173511f4ab3" returned: 0 in 0.315s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-01bb86aa-2501-4e68-b3ba-0eea04a7965f tempest-VolumesActionsTest-802655299 None] Lock "cinder-quobyte-c75db53c-a567-432e-b531-6173511f4ab3" released by "delete_volume" :: held 0.879s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:08 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:UPDATE=150,cinder:SELECT=146,cinder:INSERT=35,cinder:DELETE=11 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:52:08 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=135,cinder:UPDATE=147,cinder:DELETE=13,cinder:INSERT=32 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:52:08 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-01bb86aa-2501-4e68-b3ba-0eea04a7965f tempest-VolumesActionsTest-802655299 None] Created reservations ['f382196a-b906-4df5-a732-7b329eccb0b4', '8f72a2ba-8e60-4262-b90e-4e2cb6dcb441', '22c191e3-ae43-4b0d-95e3-f6f11f188251', '8ccd7c3f-1f2f-4fc7-a20e-e563f3de1121'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:52:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-01bb86aa-2501-4e68-b3ba-0eea04a7965f tempest-VolumesActionsTest-802655299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-01bb86aa-2501-4e68-b3ba-0eea04a7965f tempest-VolumesActionsTest-802655299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:08 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-01bb86aa-2501-4e68-b3ba-0eea04a7965f tempest-VolumesActionsTest-802655299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:08 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-01bb86aa-2501-4e68-b3ba-0eea04a7965f tempest-VolumesActionsTest-802655299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-01bb86aa-2501-4e68-b3ba-0eea04a7965f tempest-VolumesActionsTest-802655299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-01bb86aa-2501-4e68-b3ba-0eea04a7965f tempest-VolumesActionsTest-802655299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:08 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:52:08 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:08 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-01bb86aa-2501-4e68-b3ba-0eea04a7965f tempest-VolumesActionsTest-802655299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.383s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:08 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-01bb86aa-2501-4e68-b3ba-0eea04a7965f tempest-VolumesActionsTest-802655299 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:52:08 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-01bb86aa-2501-4e68-b3ba-0eea04a7965f tempest-VolumesActionsTest-802655299 None] Deleted volume successfully. Nov 05 03:52:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-01bb86aa-2501-4e68-b3ba-0eea04a7965f tempest-VolumesActionsTest-802655299 None] Lock "cinder-c75db53c-a567-432e-b531-6173511f4ab3-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Acquiring lock "cinder-quobyte-3032f973-b64b-48f7-8187-59ea54a28c29" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Lock "cinder-quobyte-3032f973-b64b-48f7-8187-59ea54a28c29" acquired by "delete_volume" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:09 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[433d3c00-158d-4002-bd66-ecaae41ed117]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3032f973-b64b-48f7-8187-59ea54a28c29 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:09 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3032f973-b64b-48f7-8187-59ea54a28c29 Nov 05 03:52:09 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:09 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3032f973-b64b-48f7-8187-59ea54a28c29" returned: 0 in 0.508s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3032f973-b64b-48f7-8187-59ea54a28c29 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:09 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3032f973-b64b-48f7-8187-59ea54a28c29 Nov 05 03:52:09 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:10 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3032f973-b64b-48f7-8187-59ea54a28c29" returned: 0 in 0.301s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Lock "cinder-quobyte-3032f973-b64b-48f7-8187-59ea54a28c29" released by "delete_volume" :: held 0.872s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Acquiring lock "cinder-quobyte-ad79d92b-5d85-491f-b1f0-f6b1f581a1f8" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Lock "cinder-quobyte-ad79d92b-5d85-491f-b1f0-f6b1f581a1f8" acquired by "delete_volume" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:10 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15b3cd1-9d97-4f2b-9090-eedc3d728627]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ad79d92b-5d85-491f-b1f0-f6b1f581a1f8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:10 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ad79d92b-5d85-491f-b1f0-f6b1f581a1f8 Nov 05 03:52:10 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:10 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ad79d92b-5d85-491f-b1f0-f6b1f581a1f8" returned: 0 in 0.473s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ad79d92b-5d85-491f-b1f0-f6b1f581a1f8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:10 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ad79d92b-5d85-491f-b1f0-f6b1f581a1f8 Nov 05 03:52:10 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:11 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ad79d92b-5d85-491f-b1f0-f6b1f581a1f8" returned: 0 in 0.277s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Lock "cinder-quobyte-ad79d92b-5d85-491f-b1f0-f6b1f581a1f8" released by "delete_volume" :: held 0.800s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:11 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Created reservations ['ca6cb2bf-62d6-4578-b34f-f1a841c71eb3'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:52:11 devstack cinder-volume[87109]: WARNING cinder.quota [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-799781675 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-799781675, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:52:11 devstack cinder-volume[87109]: WARNING cinder.quota [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-799781675 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-799781675, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:52:11 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Created reservations ['9d768e1c-422a-47a9-961e-0ca18f53c0f5', '181a4623-c008-4886-8ebe-2ffbc04c0c79', 'b0aa1640-8dd6-45e9-bf6b-3fec3f3d69c2', '0d639282-54b2-497c-affb-9a8c8017089b'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:52:11 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Created reservations ['2fddae82-55ae-4893-81ff-e046842bbf90', '9706f1db-8a25-4052-99f1-fc0dfc9c3c60', '440e9684-4058-4f98-ad86-e78b302e96e2', '90d79de5-cc87-46f6-ac2f-c900fceaf071'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:52:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:11 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:11 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:11 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:52:11 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:11 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.305s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:11 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:52:11 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-72c0ba8c-dc31-486a-8730-0115651a6463 tempest-GroupsTest-578499395 None] Delete group completed successfully. Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Flow 'volume_create_manager' (1dec4452-fd98-4a6a-aadb-620a24dfe4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676c8b6f-8f5c-4625-96a5-c8d9cbf27dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676c8b6f-8f5c-4625-96a5-c8d9cbf27dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2076865237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ceaea1-798e-468f-a143-1c0f101f8d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d210151950541a1a76b0100b7259ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:17Z,use_quota=True,user_id='f75490c4b18a40a7aecdaad2c2f5b342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e30535-08a0-4f0b-93ce-db110d7a2e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e30535-08a0-4f0b-93ce-db110d7a2e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd4f655-39ef-496f-918f-682c9afbcbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bd4f655-39ef-496f-918f-682c9afbcbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62ceaea1-798e-468f-a143-1c0f101f8d38', 'volume_name': 'volume-62ceaea1-798e-468f-a143-1c0f101f8d38', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64f330e-3ccc-4ec7-916f-fcfc84da7721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a64f330e-3ccc-4ec7-916f-fcfc84da7721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517121eb-9889-402d-a3dc-d138f3d1904d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:17 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Volume 62ceaea1-798e-468f-a143-1c0f101f8d38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62ceaea1-798e-468f-a143-1c0f101f8d38', 'volume_size': 1} Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2076865237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ceaea1-798e-468f-a143-1c0f101f8d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d210151950541a1a76b0100b7259ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:17Z,use_quota=True,user_id='f75490c4b18a40a7aecdaad2c2f5b342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Creating volume 62ceaea1-798e-468f-a143-1c0f101f8d38 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:52:17 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:52:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-62ceaea1-798e-468f-a143-1c0f101f8d38 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:17 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-62ceaea1-798e-468f-a143-1c0f101f8d38 1073741824 Nov 05 03:52:17 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Flow 'volume_create_manager' (94c9e679-74a5-4c83-b6fd-758ead4f7d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d6cab40-c0f3-418c-9abc-ea183a025eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d6cab40-c0f3-418c-9abc-ea183a025eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-913369419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1047614b-e06e-4afd-9726-058bfa3cf589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d210151950541a1a76b0100b7259ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:18Z,use_quota=True,user_id='f75490c4b18a40a7aecdaad2c2f5b342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b842681a-7493-49cc-97c9-7258b69498b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b842681a-7493-49cc-97c9-7258b69498b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7bb8572-b849-4fff-b582-9aaa3608f2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7bb8572-b849-4fff-b582-9aaa3608f2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1047614b-e06e-4afd-9726-058bfa3cf589', 'volume_name': 'volume-1047614b-e06e-4afd-9726-058bfa3cf589', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32709a08-558d-4c1e-8310-6f45711f9a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32709a08-558d-4c1e-8310-6f45711f9a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef61511-11da-48f8-a08b-432c19530da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:18 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Volume 1047614b-e06e-4afd-9726-058bfa3cf589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1047614b-e06e-4afd-9726-058bfa3cf589', 'volume_size': 1} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:18 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-62ceaea1-798e-468f-a143-1c0f101f8d38 1073741824" returned: 0 in 0.683s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-62ceaea1-798e-468f-a143-1c0f101f8d38 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:18 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-62ceaea1-798e-468f-a143-1c0f101f8d38 Nov 05 03:52:18 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:18 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-62ceaea1-798e-468f-a143-1c0f101f8d38" returned: 0 in 0.333s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.559s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-913369419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1047614b-e06e-4afd-9726-058bfa3cf589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d210151950541a1a76b0100b7259ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:18Z,use_quota=True,user_id='f75490c4b18a40a7aecdaad2c2f5b342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Creating volume 1047614b-e06e-4afd-9726-058bfa3cf589 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:52:18 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1047614b-e06e-4afd-9726-058bfa3cf589 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (517121eb-9889-402d-a3dc-d138f3d1904d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62ceaea1-798e-468f-a143-1c0f101f8d38', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:18 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1047614b-e06e-4afd-9726-058bfa3cf589 1073741824 Nov 05 03:52:18 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a3022d-41aa-44d6-8be1-e270e18ec816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:18 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Volume volume-62ceaea1-798e-468f-a143-1c0f101f8d38 (62ceaea1-798e-468f-a143-1c0f101f8d38): created successfully Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31a3022d-41aa-44d6-8be1-e270e18ec816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Flow 'volume_create_manager' (1dec4452-fd98-4a6a-aadb-620a24dfe4a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:18 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-57a8f713-ed65-42a9-9a2d-eff557d2edb1 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Created volume successfully. Nov 05 03:52:19 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1047614b-e06e-4afd-9726-058bfa3cf589 1073741824" returned: 0 in 0.655s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1047614b-e06e-4afd-9726-058bfa3cf589 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:19 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1047614b-e06e-4afd-9726-058bfa3cf589 Nov 05 03:52:19 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:19 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1047614b-e06e-4afd-9726-058bfa3cf589" returned: 0 in 0.302s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:52:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef61511-11da-48f8-a08b-432c19530da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1047614b-e06e-4afd-9726-058bfa3cf589', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc0c6bd-d253-4ff3-959e-61df2d5bccd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:19 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Volume volume-1047614b-e06e-4afd-9726-058bfa3cf589 (1047614b-e06e-4afd-9726-058bfa3cf589): created successfully Nov 05 03:52:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc0c6bd-d253-4ff3-959e-61df2d5bccd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Flow 'volume_create_manager' (94c9e679-74a5-4c83-b6fd-758ead4f7d78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:19 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f73c7c20-b146-4e32-96ea-8e88d8e71d09 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Created volume successfully. Nov 05 03:52:29 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:INSERT=8,cinder:UPDATE=35,cinder:DELETE=1,cinder:SELECT=19 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=26,cinder:INSERT=7,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Flow 'volume_create_manager' (bdc8368c-0b4d-4977-924a-7d5eb5b48fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62490881-e3a7-470c-884c-ee1720a8d31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62490881-e3a7-470c-884c-ee1720a8d31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2028321779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18e713c-4aea-4304-ad92-d58e8585b027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='643eced1b091483a8e6f9d71e9c09988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:30Z,use_quota=True,user_id='01a0b7f47d794ca0b73fffe6cdf1e454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f0e0c0-d3fd-45f4-9add-5b91d4b24566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f0e0c0-d3fd-45f4-9add-5b91d4b24566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ea6f1a-77c8-499e-9514-10d27d80df4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ea6f1a-77c8-499e-9514-10d27d80df4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18e713c-4aea-4304-ad92-d58e8585b027', 'volume_name': 'volume-b18e713c-4aea-4304-ad92-d58e8585b027', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e9a3b9-1cde-48cb-a9b1-be1c897f03d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94e9a3b9-1cde-48cb-a9b1-be1c897f03d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (610a629f-6bfe-47a6-bead-3f7570229ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:30 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Volume b18e713c-4aea-4304-ad92-d58e8585b027: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18e713c-4aea-4304-ad92-d58e8585b027', 'volume_size': 1} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2028321779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18e713c-4aea-4304-ad92-d58e8585b027,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='643eced1b091483a8e6f9d71e9c09988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:30Z,use_quota=True,user_id='01a0b7f47d794ca0b73fffe6cdf1e454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Creating volume b18e713c-4aea-4304-ad92-d58e8585b027 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:52:30 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:52:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b18e713c-4aea-4304-ad92-d58e8585b027 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:30 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b18e713c-4aea-4304-ad92-d58e8585b027 1073741824 Nov 05 03:52:30 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:31 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b18e713c-4aea-4304-ad92-d58e8585b027 1073741824" returned: 0 in 0.666s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b18e713c-4aea-4304-ad92-d58e8585b027 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:31 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b18e713c-4aea-4304-ad92-d58e8585b027 Nov 05 03:52:31 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:31 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b18e713c-4aea-4304-ad92-d58e8585b027" returned: 0 in 0.386s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:52:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (610a629f-6bfe-47a6-bead-3f7570229ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18e713c-4aea-4304-ad92-d58e8585b027', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c78b23c-e9a5-4f04-ada0-94b16dd72ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:31 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Volume volume-b18e713c-4aea-4304-ad92-d58e8585b027 (b18e713c-4aea-4304-ad92-d58e8585b027): created successfully Nov 05 03:52:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c78b23c-e9a5-4f04-ada0-94b16dd72ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Flow 'volume_create_manager' (bdc8368c-0b4d-4977-924a-7d5eb5b48fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:31 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-d524b092-e54b-44e4-837c-608e099a3633 tempest-VolumesListAdminTestJSON-1960553736 None] Created volume successfully. Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Flow 'volume_create_manager' (f1370f96-f7e2-46be-af66-b25c4cd99e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c9a710-f3d3-4d43-800f-ac4f075d677d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c9a710-f3d3-4d43-800f-ac4f075d677d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-603706820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37302d27-80fa-4281-a0fe-d1037de91a38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='643eced1b091483a8e6f9d71e9c09988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:33Z,use_quota=True,user_id='01a0b7f47d794ca0b73fffe6cdf1e454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6df4688-4245-44fa-845e-d7808d5f96cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6df4688-4245-44fa-845e-d7808d5f96cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b07393a-b981-42bf-90dc-21fab9b9e739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b07393a-b981-42bf-90dc-21fab9b9e739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37302d27-80fa-4281-a0fe-d1037de91a38', 'volume_name': 'volume-37302d27-80fa-4281-a0fe-d1037de91a38', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff807cc-b2a2-47a8-a6a0-4399f75575c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff807cc-b2a2-47a8-a6a0-4399f75575c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972f1099-345e-478b-996a-77da56113192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:33 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Volume 37302d27-80fa-4281-a0fe-d1037de91a38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37302d27-80fa-4281-a0fe-d1037de91a38', 'volume_size': 1} Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-603706820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37302d27-80fa-4281-a0fe-d1037de91a38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='643eced1b091483a8e6f9d71e9c09988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:33Z,use_quota=True,user_id='01a0b7f47d794ca0b73fffe6cdf1e454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Creating volume 37302d27-80fa-4281-a0fe-d1037de91a38 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:52:33 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:52:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-37302d27-80fa-4281-a0fe-d1037de91a38 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:33 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-37302d27-80fa-4281-a0fe-d1037de91a38 1073741824 Nov 05 03:52:33 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:34 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-37302d27-80fa-4281-a0fe-d1037de91a38 1073741824" returned: 0 in 0.466s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-37302d27-80fa-4281-a0fe-d1037de91a38 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:34 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-37302d27-80fa-4281-a0fe-d1037de91a38 Nov 05 03:52:34 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:34 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-37302d27-80fa-4281-a0fe-d1037de91a38" returned: 0 in 0.269s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:52:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972f1099-345e-478b-996a-77da56113192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37302d27-80fa-4281-a0fe-d1037de91a38', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c172a4e-fa45-4c29-a568-1ccf2f3cde17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:34 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Volume volume-37302d27-80fa-4281-a0fe-d1037de91a38 (37302d27-80fa-4281-a0fe-d1037de91a38): created successfully Nov 05 03:52:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c172a4e-fa45-4c29-a568-1ccf2f3cde17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Flow 'volume_create_manager' (f1370f96-f7e2-46be-af66-b25c4cd99e67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:34 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-175578e3-ddc5-4eb4-b033-f76177dea8fc tempest-VolumesListAdminTestJSON-1960553736 None] Created volume successfully. Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Flow 'volume_create_manager' (a909cb55-9c7c-4b33-ba49-9e566c21fb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f108427-b89b-41d3-a430-f0591be924f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f108427-b89b-41d3-a430-f0591be924f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-704400813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ef90d0-f307-49bf-b0e6-00b307f68ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='643eced1b091483a8e6f9d71e9c09988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:36Z,use_quota=True,user_id='01a0b7f47d794ca0b73fffe6cdf1e454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94dbd8f3-437d-40d2-a4ad-dd3bd5c6c247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94dbd8f3-437d-40d2-a4ad-dd3bd5c6c247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735e2691-1c6b-42fc-b005-95eef21b9e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735e2691-1c6b-42fc-b005-95eef21b9e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84ef90d0-f307-49bf-b0e6-00b307f68ab4', 'volume_name': 'volume-84ef90d0-f307-49bf-b0e6-00b307f68ab4', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c41836-3a81-4911-8fa5-9fcea78e5c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3c41836-3a81-4911-8fa5-9fcea78e5c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eff498b-6856-4ddd-b3bd-fe6f662b6e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:36 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Volume 84ef90d0-f307-49bf-b0e6-00b307f68ab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84ef90d0-f307-49bf-b0e6-00b307f68ab4', 'volume_size': 1} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-704400813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ef90d0-f307-49bf-b0e6-00b307f68ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='643eced1b091483a8e6f9d71e9c09988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:36Z,use_quota=True,user_id='01a0b7f47d794ca0b73fffe6cdf1e454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Creating volume 84ef90d0-f307-49bf-b0e6-00b307f68ab4 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:52:36 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-84ef90d0-f307-49bf-b0e6-00b307f68ab4 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:36 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-84ef90d0-f307-49bf-b0e6-00b307f68ab4 1073741824 Nov 05 03:52:36 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Flow 'volume_create_manager' (bb7a2972-56b4-48f3-8868-bedbde537b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2c1dfb-71c7-4734-b0c4-57e65c2b2f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c2c1dfb-71c7-4734-b0c4-57e65c2b2f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1232652270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2d1fee-2b8d-48d4-bd74-faf678cc0115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07538735ca2447caad8713e53a16b08e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:36Z,use_quota=True,user_id='7201564aa9f3411c82e9ff8592f79111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ab3c761-a296-4f50-b469-39870005b5df),volume_type_id=6ab3c761-a296-4f50-b469-39870005b5df)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29cc2ee9-f22a-4279-9388-ed30baaf72fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29cc2ee9-f22a-4279-9388-ed30baaf72fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36d8922-681e-4527-848b-dc386c27376b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36d8922-681e-4527-848b-dc386c27376b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac2d1fee-2b8d-48d4-bd74-faf678cc0115', 'volume_name': 'volume-ac2d1fee-2b8d-48d4-bd74-faf678cc0115', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7707e8a4-2cc2-4964-88eb-d898606573b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7707e8a4-2cc2-4964-88eb-d898606573b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8412891-e30b-41c6-8033-d4e5e7541f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:36 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Volume ac2d1fee-2b8d-48d4-bd74-faf678cc0115: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac2d1fee-2b8d-48d4-bd74-faf678cc0115', 'volume_size': 1} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:36 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-84ef90d0-f307-49bf-b0e6-00b307f68ab4 1073741824" returned: 0 in 0.439s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-84ef90d0-f307-49bf-b0e6-00b307f68ab4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:36 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-84ef90d0-f307-49bf-b0e6-00b307f68ab4 Nov 05 03:52:36 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:37 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-84ef90d0-f307-49bf-b0e6-00b307f68ab4" returned: 0 in 0.254s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.554s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1232652270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac2d1fee-2b8d-48d4-bd74-faf678cc0115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07538735ca2447caad8713e53a16b08e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:36Z,use_quota=True,user_id='7201564aa9f3411c82e9ff8592f79111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ab3c761-a296-4f50-b469-39870005b5df),volume_type_id=6ab3c761-a296-4f50-b469-39870005b5df)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Creating volume ac2d1fee-2b8d-48d4-bd74-faf678cc0115 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:52:37 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ac2d1fee-2b8d-48d4-bd74-faf678cc0115 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eff498b-6856-4ddd-b3bd-fe6f662b6e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84ef90d0-f307-49bf-b0e6-00b307f68ab4', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1818191-7c32-4e90-8d08-a622dacb447a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:37 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ac2d1fee-2b8d-48d4-bd74-faf678cc0115 1073741824 Nov 05 03:52:37 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:37 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Volume volume-84ef90d0-f307-49bf-b0e6-00b307f68ab4 (84ef90d0-f307-49bf-b0e6-00b307f68ab4): created successfully Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1818191-7c32-4e90-8d08-a622dacb447a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Flow 'volume_create_manager' (a909cb55-9c7c-4b33-ba49-9e566c21fb02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:37 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-ba3914ab-e9c6-42cd-a7f4-2deac059d282 tempest-VolumesListAdminTestJSON-1960553736 None] Created volume successfully. Nov 05 03:52:37 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ac2d1fee-2b8d-48d4-bd74-faf678cc0115 1073741824" returned: 0 in 0.485s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ac2d1fee-2b8d-48d4-bd74-faf678cc0115 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:37 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ac2d1fee-2b8d-48d4-bd74-faf678cc0115 Nov 05 03:52:37 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:37 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ac2d1fee-2b8d-48d4-bd74-faf678cc0115" returned: 0 in 0.245s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8412891-e30b-41c6-8033-d4e5e7541f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac2d1fee-2b8d-48d4-bd74-faf678cc0115', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aaac8a9-8c0d-4eca-97d6-cd9eb2c2327f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:37 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Volume volume-ac2d1fee-2b8d-48d4-bd74-faf678cc0115 (ac2d1fee-2b8d-48d4-bd74-faf678cc0115): created successfully Nov 05 03:52:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aaac8a9-8c0d-4eca-97d6-cd9eb2c2327f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Flow 'volume_create_manager' (bb7a2972-56b4-48f3-8868-bedbde537b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:38 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-74eac16d-4459-444d-acce-6cc8f97281f5 tempest-VolumeTypesAccessTest-1909292033 None] Created volume successfully. Nov 05 03:52:38 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] Acquiring lock "cinder-ac2d1fee-2b8d-48d4-bd74-faf678cc0115-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:38 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] Lock "cinder-ac2d1fee-2b8d-48d4-bd74-faf678cc0115-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:38 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] Acquiring lock "cinder-quobyte-ac2d1fee-2b8d-48d4-bd74-faf678cc0115" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:38 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] Lock "cinder-quobyte-ac2d1fee-2b8d-48d4-bd74-faf678cc0115" acquired by "delete_volume" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:38 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e16f93f-144a-4ce5-a184-fcd377e14aa6]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ac2d1fee-2b8d-48d4-bd74-faf678cc0115 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:38 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ac2d1fee-2b8d-48d4-bd74-faf678cc0115 Nov 05 03:52:38 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Flow 'volume_create_manager' (00e7caf6-b7e3-4bb2-ac52-a94d3dac7b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f1d5df-54eb-49ac-9a65-9650cfc30848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f1d5df-54eb-49ac-9a65-9650cfc30848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084afddb-0fa4-463b-a664-06cb8b1c217f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5442503842e84d3f86232a8b89ce284b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:39Z,use_quota=True,user_id='8ce028a9a4ed4061834385b41584cc7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ccd9e5-3e04-43ec-af51-7711338007f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ccd9e5-3e04-43ec-af51-7711338007f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728ca195-a1d7-465a-b07a-b0db31f6bd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728ca195-a1d7-465a-b07a-b0db31f6bd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '084afddb-0fa4-463b-a664-06cb8b1c217f', 'volume_name': 'volume-084afddb-0fa4-463b-a664-06cb8b1c217f', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a36ae6-8884-4a51-ad78-b6044c671a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a36ae6-8884-4a51-ad78-b6044c671a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a3c0b1-d433-4907-b5b4-b4bc8bfda5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:39 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Volume 084afddb-0fa4-463b-a664-06cb8b1c217f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-084afddb-0fa4-463b-a664-06cb8b1c217f', 'volume_size': 1} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084afddb-0fa4-463b-a664-06cb8b1c217f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5442503842e84d3f86232a8b89ce284b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:39Z,use_quota=True,user_id='8ce028a9a4ed4061834385b41584cc7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Creating volume 084afddb-0fa4-463b-a664-06cb8b1c217f {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:52:39 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-084afddb-0fa4-463b-a664-06cb8b1c217f 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:39 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-084afddb-0fa4-463b-a664-06cb8b1c217f 1073741824 Nov 05 03:52:39 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:39 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ac2d1fee-2b8d-48d4-bd74-faf678cc0115" returned: 0 in 0.491s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ac2d1fee-2b8d-48d4-bd74-faf678cc0115 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:39 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ac2d1fee-2b8d-48d4-bd74-faf678cc0115 Nov 05 03:52:39 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:39 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ac2d1fee-2b8d-48d4-bd74-faf678cc0115" returned: 0 in 0.259s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] Lock "cinder-quobyte-ac2d1fee-2b8d-48d4-bd74-faf678cc0115" released by "delete_volume" :: held 0.796s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:39 devstack cinder-volume[87109]: WARNING cinder.quota [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1142525899 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1142525899, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:52:39 devstack cinder-volume[87109]: WARNING cinder.quota [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1142525899 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1142525899, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] Created reservations ['83d23b18-89f4-4cea-a325-9802eb0309c5', 'b8e79d7d-4a65-4a1d-8dae-7b37277bddc9', '1419bc5c-75bd-4e01-a74f-e5e7118fae94', '9017be1e-f3bb-4bd0-a1df-bdfdb92daf11'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:52:39 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-084afddb-0fa4-463b-a664-06cb8b1c217f 1073741824" returned: 0 in 0.478s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:39 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:52:39 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-084afddb-0fa4-463b-a664-06cb8b1c217f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:39 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-084afddb-0fa4-463b-a664-06cb8b1c217f Nov 05 03:52:39 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:40 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.355s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:40 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:52:40 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] Deleted volume successfully. Nov 05 03:52:40 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-084afddb-0fa4-463b-a664-06cb8b1c217f" returned: 0 in 0.353s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:40 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:52:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8a3c0b1-d433-4907-b5b4-b4bc8bfda5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-084afddb-0fa4-463b-a664-06cb8b1c217f', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db4d6b2-b9b4-4ac4-9a4e-db78bba92b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:40 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-04bd3be9-3597-4096-ba47-e23d07e60ace tempest-VolumeTypesAccessTest-1909292033 None] Lock "cinder-ac2d1fee-2b8d-48d4-bd74-faf678cc0115-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:40 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Volume volume-084afddb-0fa4-463b-a664-06cb8b1c217f (084afddb-0fa4-463b-a664-06cb8b1c217f): created successfully Nov 05 03:52:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db4d6b2-b9b4-4ac4-9a4e-db78bba92b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Flow 'volume_create_manager' (00e7caf6-b7e3-4bb2-ac52-a94d3dac7b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:40 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-e3559af9-8e40-4903-8b5b-746b38e97e7f tempest-VolumesListAdminTestJSON-111364688 None] Created volume successfully. Nov 05 03:52:41 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-183733b1-06e6-4901-94e7-9c6fb8274100 tempest-VolumesListAdminTestJSON-111364688 None] Acquiring lock "cinder-084afddb-0fa4-463b-a664-06cb8b1c217f-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:41 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-183733b1-06e6-4901-94e7-9c6fb8274100 tempest-VolumesListAdminTestJSON-111364688 None] Lock "cinder-084afddb-0fa4-463b-a664-06cb8b1c217f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:41 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-183733b1-06e6-4901-94e7-9c6fb8274100 tempest-VolumesListAdminTestJSON-111364688 None] Acquiring lock "cinder-quobyte-084afddb-0fa4-463b-a664-06cb8b1c217f" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:41 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-183733b1-06e6-4901-94e7-9c6fb8274100 tempest-VolumesListAdminTestJSON-111364688 None] Lock "cinder-quobyte-084afddb-0fa4-463b-a664-06cb8b1c217f" acquired by "delete_volume" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:41 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaea57b-5b5e-497f-8498-bffd2e216c6c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-183733b1-06e6-4901-94e7-9c6fb8274100 tempest-VolumesListAdminTestJSON-111364688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-084afddb-0fa4-463b-a664-06cb8b1c217f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:41 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-451d8d18-2ea0-413c-9d0d-e1a3eac389a1 tempest-VolumesListAdminTestJSON-1960553736 None] Acquiring lock "cinder-84ef90d0-f307-49bf-b0e6-00b307f68ab4-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:41 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-451d8d18-2ea0-413c-9d0d-e1a3eac389a1 tempest-VolumesListAdminTestJSON-1960553736 None] Lock "cinder-84ef90d0-f307-49bf-b0e6-00b307f68ab4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:41 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-451d8d18-2ea0-413c-9d0d-e1a3eac389a1 tempest-VolumesListAdminTestJSON-1960553736 None] Acquiring lock "cinder-quobyte-84ef90d0-f307-49bf-b0e6-00b307f68ab4" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:41 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-084afddb-0fa4-463b-a664-06cb8b1c217f Nov 05 03:52:41 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:41 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-451d8d18-2ea0-413c-9d0d-e1a3eac389a1 tempest-VolumesListAdminTestJSON-1960553736 None] Lock "cinder-quobyte-84ef90d0-f307-49bf-b0e6-00b307f68ab4" acquired by "delete_volume" :: waited 0.014s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:41 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f84727-3ba1-4bd8-aea1-cadde859b4f4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-451d8d18-2ea0-413c-9d0d-e1a3eac389a1 tempest-VolumesListAdminTestJSON-1960553736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-84ef90d0-f307-49bf-b0e6-00b307f68ab4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:41 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-84ef90d0-f307-49bf-b0e6-00b307f68ab4 Nov 05 03:52:41 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:41 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-183733b1-06e6-4901-94e7-9c6fb8274100 tempest-VolumesListAdminTestJSON-111364688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-084afddb-0fa4-463b-a664-06cb8b1c217f" returned: 0 in 0.479s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-183733b1-06e6-4901-94e7-9c6fb8274100 tempest-VolumesListAdminTestJSON-111364688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-084afddb-0fa4-463b-a664-06cb8b1c217f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:41 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-084afddb-0fa4-463b-a664-06cb8b1c217f Nov 05 03:52:41 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:42 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-451d8d18-2ea0-413c-9d0d-e1a3eac389a1 tempest-VolumesListAdminTestJSON-1960553736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-84ef90d0-f307-49bf-b0e6-00b307f68ab4" returned: 0 in 0.435s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-451d8d18-2ea0-413c-9d0d-e1a3eac389a1 tempest-VolumesListAdminTestJSON-1960553736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-84ef90d0-f307-49bf-b0e6-00b307f68ab4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:42 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-84ef90d0-f307-49bf-b0e6-00b307f68ab4 Nov 05 03:52:42 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:42 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-183733b1-06e6-4901-94e7-9c6fb8274100 tempest-VolumesListAdminTestJSON-111364688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-084afddb-0fa4-463b-a664-06cb8b1c217f" returned: 0 in 0.302s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-183733b1-06e6-4901-94e7-9c6fb8274100 tempest-VolumesListAdminTestJSON-111364688 None] Lock "cinder-quobyte-084afddb-0fa4-463b-a664-06cb8b1c217f" released by "delete_volume" :: held 0.844s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:42 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-451d8d18-2ea0-413c-9d0d-e1a3eac389a1 tempest-VolumesListAdminTestJSON-1960553736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-84ef90d0-f307-49bf-b0e6-00b307f68ab4" returned: 0 in 0.308s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-451d8d18-2ea0-413c-9d0d-e1a3eac389a1 tempest-VolumesListAdminTestJSON-1960553736 None] Lock "cinder-quobyte-84ef90d0-f307-49bf-b0e6-00b307f68ab4" released by "delete_volume" :: held 0.804s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-183733b1-06e6-4901-94e7-9c6fb8274100 tempest-VolumesListAdminTestJSON-111364688 None] Created reservations ['b8dac5ec-fc09-495e-a76b-6a13f08b01cc', 'fdfe70ea-e6d0-4817-9fe8-c9bf83ac790b', 'cf439e5e-c6c9-4638-b7b8-18d59f0c8ebc', '0132b133-34ae-429f-a7af-b21132cf0c8a'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-451d8d18-2ea0-413c-9d0d-e1a3eac389a1 tempest-VolumesListAdminTestJSON-1960553736 None] Created reservations ['ddfca342-c80e-4e4e-80f4-f43f502c6f63', '6a91bdb4-5e36-4c1a-be19-724d473d2139', 'd79a6dcd-4549-4edd-8889-797543c40352', '42abf782-7b42-44b6-a48e-2c58a5e523b8'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-183733b1-06e6-4901-94e7-9c6fb8274100 tempest-VolumesListAdminTestJSON-111364688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-183733b1-06e6-4901-94e7-9c6fb8274100 tempest-VolumesListAdminTestJSON-111364688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-183733b1-06e6-4901-94e7-9c6fb8274100 tempest-VolumesListAdminTestJSON-111364688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-183733b1-06e6-4901-94e7-9c6fb8274100 tempest-VolumesListAdminTestJSON-111364688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-183733b1-06e6-4901-94e7-9c6fb8274100 tempest-VolumesListAdminTestJSON-111364688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-183733b1-06e6-4901-94e7-9c6fb8274100 tempest-VolumesListAdminTestJSON-111364688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:42 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:52:42 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-451d8d18-2ea0-413c-9d0d-e1a3eac389a1 tempest-VolumesListAdminTestJSON-1960553736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-451d8d18-2ea0-413c-9d0d-e1a3eac389a1 tempest-VolumesListAdminTestJSON-1960553736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-451d8d18-2ea0-413c-9d0d-e1a3eac389a1 tempest-VolumesListAdminTestJSON-1960553736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-451d8d18-2ea0-413c-9d0d-e1a3eac389a1 tempest-VolumesListAdminTestJSON-1960553736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-451d8d18-2ea0-413c-9d0d-e1a3eac389a1 tempest-VolumesListAdminTestJSON-1960553736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-451d8d18-2ea0-413c-9d0d-e1a3eac389a1 tempest-VolumesListAdminTestJSON-1960553736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:42 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:52:42 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:42 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-183733b1-06e6-4901-94e7-9c6fb8274100 tempest-VolumesListAdminTestJSON-111364688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.315s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-183733b1-06e6-4901-94e7-9c6fb8274100 tempest-VolumesListAdminTestJSON-111364688 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:52:42 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-183733b1-06e6-4901-94e7-9c6fb8274100 tempest-VolumesListAdminTestJSON-111364688 None] Deleted volume successfully. Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-27903850-efa8-49bb-9ea5-1357adf1987a tempest-VolumesListAdminTestJSON-1960553736 None] Acquiring lock "cinder-37302d27-80fa-4281-a0fe-d1037de91a38-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-27903850-efa8-49bb-9ea5-1357adf1987a tempest-VolumesListAdminTestJSON-1960553736 None] Lock "cinder-37302d27-80fa-4281-a0fe-d1037de91a38-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-183733b1-06e6-4901-94e7-9c6fb8274100 tempest-VolumesListAdminTestJSON-111364688 None] Lock "cinder-084afddb-0fa4-463b-a664-06cb8b1c217f-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:42 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-451d8d18-2ea0-413c-9d0d-e1a3eac389a1 tempest-VolumesListAdminTestJSON-1960553736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.376s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:42 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-451d8d18-2ea0-413c-9d0d-e1a3eac389a1 tempest-VolumesListAdminTestJSON-1960553736 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:52:42 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-451d8d18-2ea0-413c-9d0d-e1a3eac389a1 tempest-VolumesListAdminTestJSON-1960553736 None] Deleted volume successfully. Nov 05 03:52:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-451d8d18-2ea0-413c-9d0d-e1a3eac389a1 tempest-VolumesListAdminTestJSON-1960553736 None] Lock "cinder-84ef90d0-f307-49bf-b0e6-00b307f68ab4-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-27903850-efa8-49bb-9ea5-1357adf1987a tempest-VolumesListAdminTestJSON-1960553736 None] Acquiring lock "cinder-quobyte-37302d27-80fa-4281-a0fe-d1037de91a38" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-27903850-efa8-49bb-9ea5-1357adf1987a tempest-VolumesListAdminTestJSON-1960553736 None] Lock "cinder-quobyte-37302d27-80fa-4281-a0fe-d1037de91a38" acquired by "delete_volume" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:43 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecac5b40-2dc6-40b3-a64f-0384517af94f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-27903850-efa8-49bb-9ea5-1357adf1987a tempest-VolumesListAdminTestJSON-1960553736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-37302d27-80fa-4281-a0fe-d1037de91a38 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:43 devstack sudo[99653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-37302d27-80fa-4281-a0fe-d1037de91a38 Nov 05 03:52:43 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:43 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-27903850-efa8-49bb-9ea5-1357adf1987a tempest-VolumesListAdminTestJSON-1960553736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-37302d27-80fa-4281-a0fe-d1037de91a38" returned: 0 in 0.415s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-27903850-efa8-49bb-9ea5-1357adf1987a tempest-VolumesListAdminTestJSON-1960553736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-37302d27-80fa-4281-a0fe-d1037de91a38 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:43 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-37302d27-80fa-4281-a0fe-d1037de91a38 Nov 05 03:52:43 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:43 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-27903850-efa8-49bb-9ea5-1357adf1987a tempest-VolumesListAdminTestJSON-1960553736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-37302d27-80fa-4281-a0fe-d1037de91a38" returned: 0 in 0.260s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-27903850-efa8-49bb-9ea5-1357adf1987a tempest-VolumesListAdminTestJSON-1960553736 None] Lock "cinder-quobyte-37302d27-80fa-4281-a0fe-d1037de91a38" released by "delete_volume" :: held 0.721s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:43 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-27903850-efa8-49bb-9ea5-1357adf1987a tempest-VolumesListAdminTestJSON-1960553736 None] Created reservations ['4293f468-0e46-4de4-a731-9de85f516f28', '287c69c9-6eb3-4d14-b5f7-feddeea998d3', '22008cc9-4d74-4d19-ba01-d15d07f1deb4', '8de38c7f-464b-41b0-beb3-43976cd51765'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:52:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-27903850-efa8-49bb-9ea5-1357adf1987a tempest-VolumesListAdminTestJSON-1960553736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-27903850-efa8-49bb-9ea5-1357adf1987a tempest-VolumesListAdminTestJSON-1960553736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:43 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-27903850-efa8-49bb-9ea5-1357adf1987a tempest-VolumesListAdminTestJSON-1960553736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:43 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-27903850-efa8-49bb-9ea5-1357adf1987a tempest-VolumesListAdminTestJSON-1960553736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-27903850-efa8-49bb-9ea5-1357adf1987a tempest-VolumesListAdminTestJSON-1960553736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-27903850-efa8-49bb-9ea5-1357adf1987a tempest-VolumesListAdminTestJSON-1960553736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:43 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:52:43 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-aba94fca-e507-46bd-a6e0-a5fb62c193da tempest-VolumesListAdminTestJSON-1960553736 None] Acquiring lock "cinder-b18e713c-4aea-4304-ad92-d58e8585b027-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-aba94fca-e507-46bd-a6e0-a5fb62c193da tempest-VolumesListAdminTestJSON-1960553736 None] Lock "cinder-b18e713c-4aea-4304-ad92-d58e8585b027-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:44 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-27903850-efa8-49bb-9ea5-1357adf1987a tempest-VolumesListAdminTestJSON-1960553736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.326s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:44 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-27903850-efa8-49bb-9ea5-1357adf1987a tempest-VolumesListAdminTestJSON-1960553736 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:52:44 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-27903850-efa8-49bb-9ea5-1357adf1987a tempest-VolumesListAdminTestJSON-1960553736 None] Deleted volume successfully. Nov 05 03:52:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-aba94fca-e507-46bd-a6e0-a5fb62c193da tempest-VolumesListAdminTestJSON-1960553736 None] Acquiring lock "cinder-quobyte-b18e713c-4aea-4304-ad92-d58e8585b027" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:52:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-27903850-efa8-49bb-9ea5-1357adf1987a tempest-VolumesListAdminTestJSON-1960553736 None] Lock "cinder-37302d27-80fa-4281-a0fe-d1037de91a38-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-aba94fca-e507-46bd-a6e0-a5fb62c193da tempest-VolumesListAdminTestJSON-1960553736 None] Lock "cinder-quobyte-b18e713c-4aea-4304-ad92-d58e8585b027" acquired by "delete_volume" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:52:44 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cc80cf-1ba7-4426-bd78-48523b649125]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aba94fca-e507-46bd-a6e0-a5fb62c193da tempest-VolumesListAdminTestJSON-1960553736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b18e713c-4aea-4304-ad92-d58e8585b027 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:44 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b18e713c-4aea-4304-ad92-d58e8585b027 Nov 05 03:52:44 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:44 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aba94fca-e507-46bd-a6e0-a5fb62c193da tempest-VolumesListAdminTestJSON-1960553736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b18e713c-4aea-4304-ad92-d58e8585b027" returned: 0 in 0.413s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aba94fca-e507-46bd-a6e0-a5fb62c193da tempest-VolumesListAdminTestJSON-1960553736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b18e713c-4aea-4304-ad92-d58e8585b027 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:44 devstack sudo[99669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b18e713c-4aea-4304-ad92-d58e8585b027 Nov 05 03:52:44 devstack sudo[99669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:45 devstack sudo[99669]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aba94fca-e507-46bd-a6e0-a5fb62c193da tempest-VolumesListAdminTestJSON-1960553736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b18e713c-4aea-4304-ad92-d58e8585b027" returned: 0 in 0.289s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-aba94fca-e507-46bd-a6e0-a5fb62c193da tempest-VolumesListAdminTestJSON-1960553736 None] Lock "cinder-quobyte-b18e713c-4aea-4304-ad92-d58e8585b027" released by "delete_volume" :: held 0.756s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:45 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-aba94fca-e507-46bd-a6e0-a5fb62c193da tempest-VolumesListAdminTestJSON-1960553736 None] Created reservations ['824d9c23-2377-48ab-92cf-f95bdda6a303', '1d0e4db6-455e-4b45-8973-1569d98d5bf7', '8b30ce0d-53df-4ccc-896b-51c4fe6243ad', '750918a3-f651-4d67-aaf0-6fcb4766ddbf'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:52:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aba94fca-e507-46bd-a6e0-a5fb62c193da tempest-VolumesListAdminTestJSON-1960553736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aba94fca-e507-46bd-a6e0-a5fb62c193da tempest-VolumesListAdminTestJSON-1960553736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:45 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-aba94fca-e507-46bd-a6e0-a5fb62c193da tempest-VolumesListAdminTestJSON-1960553736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:45 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-aba94fca-e507-46bd-a6e0-a5fb62c193da tempest-VolumesListAdminTestJSON-1960553736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aba94fca-e507-46bd-a6e0-a5fb62c193da tempest-VolumesListAdminTestJSON-1960553736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aba94fca-e507-46bd-a6e0-a5fb62c193da tempest-VolumesListAdminTestJSON-1960553736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:45 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:52:45 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:45 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aba94fca-e507-46bd-a6e0-a5fb62c193da tempest-VolumesListAdminTestJSON-1960553736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.263s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:45 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-aba94fca-e507-46bd-a6e0-a5fb62c193da tempest-VolumesListAdminTestJSON-1960553736 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:52:45 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-aba94fca-e507-46bd-a6e0-a5fb62c193da tempest-VolumesListAdminTestJSON-1960553736 None] Deleted volume successfully. Nov 05 03:52:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-aba94fca-e507-46bd-a6e0-a5fb62c193da tempest-VolumesListAdminTestJSON-1960553736 None] Lock "cinder-b18e713c-4aea-4304-ad92-d58e8585b027-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:52:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-7fc7534a-9ac0-4eb7-b6f9-26e4adfcf9f6 req-5ac7682e-dbf4-473c-b546-dc85ffb85b1b tempest-TestServerVolumeAttachmentScenario-1363121332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-7fc7534a-9ac0-4eb7-b6f9-26e4adfcf9f6 req-5ac7682e-dbf4-473c-b546-dc85ffb85b1b tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-7fc7534a-9ac0-4eb7-b6f9-26e4adfcf9f6 req-5ac7682e-dbf4-473c-b546-dc85ffb85b1b tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-7fc7534a-9ac0-4eb7-b6f9-26e4adfcf9f6 req-5ac7682e-dbf4-473c-b546-dc85ffb85b1b tempest-TestServerVolumeAttachmentScenario-1363121332 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-62ceaea1-798e-468f-a143-1c0f101f8d38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0cdfaa28-d5d0-42b9-998f-acd19d7f5d7e', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:52:52 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-7fc7534a-9ac0-4eb7-b6f9-26e4adfcf9f6 req-5ac7682e-dbf4-473c-b546-dc85ffb85b1b tempest-TestServerVolumeAttachmentScenario-1363121332 None] attachment_update completed successfully. Nov 05 03:52:55 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:52:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Flow 'volume_create_manager' (de583185-1c61-413c-a568-f0a9a2f9e812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:52:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227141fa-5a93-47a5-9b00-073494a801aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227141fa-5a93-47a5-9b00-073494a801aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1506603309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db77f07-706a-4526-bc6b-e151913e7fe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e7a160d93b4509ba2c685578709bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:56Z,use_quota=True,user_id='376f627dffca4eb5a0fca109fc46ed02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30150fe2-7690-42e9-961c-433fc71855ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30150fe2-7690-42e9-961c-433fc71855ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d3e6e5-8751-499c-a124-d6cc53acc057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:55 devstack cinder-volume[87109]: DEBUG cinder.image.glance [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Creating Keystone auth plugin from conf {{(pid=87109) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 03:52:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d3e6e5-8751-499c-a124-d6cc53acc057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4db77f07-706a-4526-bc6b-e151913e7fe1', 'volume_name': 'volume-4db77f07-706a-4526-bc6b-e151913e7fe1', 'volume_size': 1, 'image_id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9a2a266d3247698576f415a1551384', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed8dc2b-99c7-4534-bb5a-1c87043b66cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed8dc2b-99c7-4534-bb5a-1c87043b66cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:52:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8987d9-80dc-4123-95b4-a56c50ed777b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:52:56 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Volume 4db77f07-706a-4526-bc6b-e151913e7fe1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4db77f07-706a-4526-bc6b-e151913e7fe1', 'volume_size': 1, 'image_id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9a2a266d3247698576f415a1551384', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 03:52:56 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Trying to clone 4db77f07-706a-4526-bc6b-e151913e7fe1 from image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}]). {{(pid=87109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 03:52:56 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_we2zud_tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 05 03:52:56 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Image download 20.69 MB at 20.69 MB/s Nov 05 03:52:56 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d6558f-7a34-4257-ade0-8b193159774a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_we2zud_tdevstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:56 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_we2zud_tdevstack@QuobyteHD Nov 05 03:52:56 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:57 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_we2zud_tdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:57 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Temporary image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 is fetched for user 376f627dffca4eb5a0fca109fc46ed02. {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 05 03:52:57 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec529e0-5be5-4890-879b-e1f9c69b0921]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_we2zud_tdevstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-c7c359f0-8a5d-43fe-a542-93f159e8f2a7 req-f19126e4-3c7b-4513-b60b-ed69dd54cb93 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-c7c359f0-8a5d-43fe-a542-93f159e8f2a7 req-f19126e4-3c7b-4513-b60b-ed69dd54cb93 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-c7c359f0-8a5d-43fe-a542-93f159e8f2a7 req-f19126e4-3c7b-4513-b60b-ed69dd54cb93 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-c7c359f0-8a5d-43fe-a542-93f159e8f2a7 req-f19126e4-3c7b-4513-b60b-ed69dd54cb93 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-1047614b-e06e-4afd-9726-058bfa3cf589', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06753d5f-b369-4474-82b9-377768123eb7', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:52:57 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_we2zud_tdevstack@QuobyteHD Nov 05 03:52:57 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:57 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-c7c359f0-8a5d-43fe-a542-93f159e8f2a7 req-f19126e4-3c7b-4513-b60b-ed69dd54cb93 tempest-TestServerVolumeAttachmentScenario-1363121332 None] attachment_update completed successfully. Nov 05 03:52:57 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_we2zud_tdevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:52:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1506603309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db77f07-706a-4526-bc6b-e151913e7fe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56e7a160d93b4509ba2c685578709bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:52:56Z,use_quota=True,user_id='376f627dffca4eb5a0fca109fc46ed02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:52:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Creating volume 4db77f07-706a-4526-bc6b-e151913e7fe1 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:52:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:52:57 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:52:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4db77f07-706a-4526-bc6b-e151913e7fe1 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:57 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4db77f07-706a-4526-bc6b-e151913e7fe1 1073741824 Nov 05 03:52:57 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:58 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4db77f07-706a-4526-bc6b-e151913e7fe1 1073741824" returned: 0 in 0.657s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4db77f07-706a-4526-bc6b-e151913e7fe1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:58 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4db77f07-706a-4526-bc6b-e151913e7fe1 Nov 05 03:52:58 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:52:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:52:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:52:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:52:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:52:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:58 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:52:58 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:58 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4db77f07-706a-4526-bc6b-e151913e7fe1" returned: 0 in 0.255s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:52:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:52:58 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Attempting download of b71101b4-5e1f-4b78-90ce-ec8cda8c1237 ((None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}])) to volume 4db77f07-706a-4526-bc6b-e151913e7fe1. {{(pid=87109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 05 03:52:58 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3771705c-64db-47f0-8a35-56c5873e39af]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_pm5i31jt {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:58 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.282s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:58 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:52:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:52:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 28 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:52:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:52:58 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_pm5i31jt Nov 05 03:52:58 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:59 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_pm5i31jt" returned: 0 in 0.357s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_pm5i31jt {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:59 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_pm5i31jt Nov 05 03:52:59 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:52:59 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Nov 05 03:52:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_pm5i31jt" returned: 1 in 0.436s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:52:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_pm5i31jt' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:52:59 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[6913e873-11b3-4159-8173-bfd8724b0d56]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:52:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_we2zud_tdevstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:52:59 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_we2zud_tdevstack@QuobyteHD Nov 05 03:52:59 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:00 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_we2zud_tdevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:00 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] b71101b4-5e1f-4b78-90ce-ec8cda8c1237 was qcow2, converting to qcow2 {{(pid=87109) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 05 03:53:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_we2zud_tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4db77f07-706a-4526-bc6b-e151913e7fe1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:00 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_we2zud_tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4db77f07-706a-4526-bc6b-e151913e7fe1 Nov 05 03:53:00 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:00 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-1c63dc25-fdf7-4c3f-b93e-9db7571fe433 req-fadba2d6-b389-41bb-a555-7ab5f7f063cf tempest-TestServerVolumeAttachmentScenario-1363121332 None] Terminate volume connection completed successfully. Nov 05 03:53:00 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-1c63dc25-fdf7-4c3f-b93e-9db7571fe433 req-fadba2d6-b389-41bb-a555-7ab5f7f063cf tempest-TestServerVolumeAttachmentScenario-1363121332 None] Deleting attachment 06753d5f-b369-4474-82b9-377768123eb7. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:53:02 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-d1435cc4-4de6-4fb0-b54f-1eb148509e3b req-70bdc7be-0fd5-40ca-8fa7-413ff6573953 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Terminate volume connection completed successfully. Nov 05 03:53:02 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-d1435cc4-4de6-4fb0-b54f-1eb148509e3b req-70bdc7be-0fd5-40ca-8fa7-413ff6573953 tempest-TestServerVolumeAttachmentScenario-1363121332 None] Deleting attachment 0cdfaa28-d5d0-42b9-998f-acd19d7f5d7e. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:53:02 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_we2zud_tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4db77f07-706a-4526-bc6b-e151913e7fe1" returned: 0 in 2.298s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:02 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_we2zud_tdevstack@QuobyteHD, size 112.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4db77f07-706a-4526-bc6b-e151913e7fe1 {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:53:02 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Converted 112.00 MB image at 48.72 MB/s Nov 05 03:53:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4db77f07-706a-4526-bc6b-e151913e7fe1 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:02 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4db77f07-706a-4526-bc6b-e151913e7fe1 1G Nov 05 03:53:02 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:02 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4db77f07-706a-4526-bc6b-e151913e7fe1 1G" returned: 0 in 0.438s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:02 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Downloaded image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 ((None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}])) to volume 4db77f07-706a-4526-bc6b-e151913e7fe1 successfully. {{(pid=87109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 05 03:53:02 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Temporary image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 for user 376f627dffca4eb5a0fca109fc46ed02 is deleted. {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 05 03:53:02 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Marking volume 4db77f07-706a-4526-bc6b-e151913e7fe1 as bootable. {{(pid=87109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 05 03:53:02 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Copying metadata from image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 to 4db77f07-706a-4526-bc6b-e151913e7fe1. {{(pid=87109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 03:53:02 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Creating volume glance metadata for volume 4db77f07-706a-4526-bc6b-e151913e7fe1 backed by image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 03:53:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8987d9-80dc-4123-95b4-a56c50ed777b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db77f07-706a-4526-bc6b-e151913e7fe1', 'volume_size': 1, 'image_id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9a2a266d3247698576f415a1551384', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a81770e-80a3-4767-abdc-ef80f2448edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:03 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Volume volume-4db77f07-706a-4526-bc6b-e151913e7fe1 (4db77f07-706a-4526-bc6b-e151913e7fe1): created successfully Nov 05 03:53:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a81770e-80a3-4767-abdc-ef80f2448edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Flow 'volume_create_manager' (de583185-1c61-413c-a568-f0a9a2f9e812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:03 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-7432b36c-962f-4792-a9bd-ab512ae1c563 tempest-VolumesImageMetadata-2040886443 None] Created volume successfully. Nov 05 03:53:04 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4fc6016e-70f3-448b-aee7-15a90d3b6688 tempest-VolumesImageMetadata-2040886443 None] Acquiring lock "cinder-4db77f07-706a-4526-bc6b-e151913e7fe1-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:04 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4fc6016e-70f3-448b-aee7-15a90d3b6688 tempest-VolumesImageMetadata-2040886443 None] Lock "cinder-4db77f07-706a-4526-bc6b-e151913e7fe1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:04 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4fc6016e-70f3-448b-aee7-15a90d3b6688 tempest-VolumesImageMetadata-2040886443 None] Acquiring lock "cinder-quobyte-4db77f07-706a-4526-bc6b-e151913e7fe1" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:04 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4fc6016e-70f3-448b-aee7-15a90d3b6688 tempest-VolumesImageMetadata-2040886443 None] Lock "cinder-quobyte-4db77f07-706a-4526-bc6b-e151913e7fe1" acquired by "delete_volume" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:04 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c484d71e-02dd-4c6b-8b12-514daa947316]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4fc6016e-70f3-448b-aee7-15a90d3b6688 tempest-VolumesImageMetadata-2040886443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4db77f07-706a-4526-bc6b-e151913e7fe1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:04 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4db77f07-706a-4526-bc6b-e151913e7fe1 Nov 05 03:53:04 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:04 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4fc6016e-70f3-448b-aee7-15a90d3b6688 tempest-VolumesImageMetadata-2040886443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4db77f07-706a-4526-bc6b-e151913e7fe1" returned: 0 in 0.502s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4fc6016e-70f3-448b-aee7-15a90d3b6688 tempest-VolumesImageMetadata-2040886443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4db77f07-706a-4526-bc6b-e151913e7fe1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:04 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4db77f07-706a-4526-bc6b-e151913e7fe1 Nov 05 03:53:04 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:04 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4fc6016e-70f3-448b-aee7-15a90d3b6688 tempest-VolumesImageMetadata-2040886443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4db77f07-706a-4526-bc6b-e151913e7fe1" returned: 0 in 0.277s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:04 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4fc6016e-70f3-448b-aee7-15a90d3b6688 tempest-VolumesImageMetadata-2040886443 None] Lock "cinder-quobyte-4db77f07-706a-4526-bc6b-e151913e7fe1" released by "delete_volume" :: held 0.837s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:05 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-4fc6016e-70f3-448b-aee7-15a90d3b6688 tempest-VolumesImageMetadata-2040886443 None] Created reservations ['f5a54e1c-a289-484a-9b33-f3c4ea6338ef', '7adc93e5-a5fc-45d2-af59-cd2fac760763', 'f8ce221a-f957-41fe-8ffe-e157ed3079dc', '44aea488-9146-4395-bd0c-bf54ce5c54c8'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4fc6016e-70f3-448b-aee7-15a90d3b6688 tempest-VolumesImageMetadata-2040886443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4fc6016e-70f3-448b-aee7-15a90d3b6688 tempest-VolumesImageMetadata-2040886443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4fc6016e-70f3-448b-aee7-15a90d3b6688 tempest-VolumesImageMetadata-2040886443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4fc6016e-70f3-448b-aee7-15a90d3b6688 tempest-VolumesImageMetadata-2040886443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4fc6016e-70f3-448b-aee7-15a90d3b6688 tempest-VolumesImageMetadata-2040886443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4fc6016e-70f3-448b-aee7-15a90d3b6688 tempest-VolumesImageMetadata-2040886443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:05 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:53:05 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:05 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4fc6016e-70f3-448b-aee7-15a90d3b6688 tempest-VolumesImageMetadata-2040886443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.315s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:05 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-4fc6016e-70f3-448b-aee7-15a90d3b6688 tempest-VolumesImageMetadata-2040886443 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:05 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-4fc6016e-70f3-448b-aee7-15a90d3b6688 tempest-VolumesImageMetadata-2040886443 None] Deleted volume successfully. Nov 05 03:53:05 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4fc6016e-70f3-448b-aee7-15a90d3b6688 tempest-VolumesImageMetadata-2040886443 None] Lock "cinder-4db77f07-706a-4526-bc6b-e151913e7fe1-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-e00106f8-5499-4d67-af11-2aff11c35ebe tempest-TestServerVolumeAttachmentScenario-1363121332 None] Acquiring lock "cinder-1047614b-e06e-4afd-9726-058bfa3cf589-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-e00106f8-5499-4d67-af11-2aff11c35ebe tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "cinder-1047614b-e06e-4afd-9726-058bfa3cf589-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-e00106f8-5499-4d67-af11-2aff11c35ebe tempest-TestServerVolumeAttachmentScenario-1363121332 None] Acquiring lock "cinder-quobyte-1047614b-e06e-4afd-9726-058bfa3cf589" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-e00106f8-5499-4d67-af11-2aff11c35ebe tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "cinder-quobyte-1047614b-e06e-4afd-9726-058bfa3cf589" acquired by "delete_volume" :: waited 0.022s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:08 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fc6bbf-ff54-48cd-9b6a-6df7d693d6e3]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e00106f8-5499-4d67-af11-2aff11c35ebe tempest-TestServerVolumeAttachmentScenario-1363121332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1047614b-e06e-4afd-9726-058bfa3cf589 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:08 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1047614b-e06e-4afd-9726-058bfa3cf589 Nov 05 03:53:08 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:09 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e00106f8-5499-4d67-af11-2aff11c35ebe tempest-TestServerVolumeAttachmentScenario-1363121332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1047614b-e06e-4afd-9726-058bfa3cf589" returned: 0 in 0.414s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e00106f8-5499-4d67-af11-2aff11c35ebe tempest-TestServerVolumeAttachmentScenario-1363121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1047614b-e06e-4afd-9726-058bfa3cf589 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:09 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1047614b-e06e-4afd-9726-058bfa3cf589 Nov 05 03:53:09 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:09 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e00106f8-5499-4d67-af11-2aff11c35ebe tempest-TestServerVolumeAttachmentScenario-1363121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1047614b-e06e-4afd-9726-058bfa3cf589" returned: 0 in 0.268s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-e00106f8-5499-4d67-af11-2aff11c35ebe tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "cinder-quobyte-1047614b-e06e-4afd-9726-058bfa3cf589" released by "delete_volume" :: held 0.733s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:09 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-e00106f8-5499-4d67-af11-2aff11c35ebe tempest-TestServerVolumeAttachmentScenario-1363121332 None] Created reservations ['b81d8848-6867-44b7-8967-859a24ad90b6', 'c8f83b47-5983-4231-9eed-25b4ffade950', 'f59498b8-fc43-4049-9ddf-8f3821cb9772', '833e3ac8-6c8c-41ee-9141-77494e28eb58'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e00106f8-5499-4d67-af11-2aff11c35ebe tempest-TestServerVolumeAttachmentScenario-1363121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e00106f8-5499-4d67-af11-2aff11c35ebe tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e00106f8-5499-4d67-af11-2aff11c35ebe tempest-TestServerVolumeAttachmentScenario-1363121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e00106f8-5499-4d67-af11-2aff11c35ebe tempest-TestServerVolumeAttachmentScenario-1363121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e00106f8-5499-4d67-af11-2aff11c35ebe tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e00106f8-5499-4d67-af11-2aff11c35ebe tempest-TestServerVolumeAttachmentScenario-1363121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:09 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:53:09 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9a059a5e-7e31-4db3-8bcd-21a77404eb7b tempest-TestServerVolumeAttachmentScenario-1363121332 None] Acquiring lock "cinder-62ceaea1-798e-468f-a143-1c0f101f8d38-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:09 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e00106f8-5499-4d67-af11-2aff11c35ebe tempest-TestServerVolumeAttachmentScenario-1363121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.295s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:09 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-e00106f8-5499-4d67-af11-2aff11c35ebe tempest-TestServerVolumeAttachmentScenario-1363121332 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:09 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-e00106f8-5499-4d67-af11-2aff11c35ebe tempest-TestServerVolumeAttachmentScenario-1363121332 None] Deleted volume successfully. Nov 05 03:53:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9a059a5e-7e31-4db3-8bcd-21a77404eb7b tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "cinder-62ceaea1-798e-468f-a143-1c0f101f8d38-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-e00106f8-5499-4d67-af11-2aff11c35ebe tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "cinder-1047614b-e06e-4afd-9726-058bfa3cf589-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9a059a5e-7e31-4db3-8bcd-21a77404eb7b tempest-TestServerVolumeAttachmentScenario-1363121332 None] Acquiring lock "cinder-quobyte-62ceaea1-798e-468f-a143-1c0f101f8d38" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9a059a5e-7e31-4db3-8bcd-21a77404eb7b tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "cinder-quobyte-62ceaea1-798e-468f-a143-1c0f101f8d38" acquired by "delete_volume" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[56be9949-8268-46e4-a88c-3f178f9df250]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9a059a5e-7e31-4db3-8bcd-21a77404eb7b tempest-TestServerVolumeAttachmentScenario-1363121332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-62ceaea1-798e-468f-a143-1c0f101f8d38 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:10 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-62ceaea1-798e-468f-a143-1c0f101f8d38 Nov 05 03:53:10 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Flow 'volume_create_manager' (9398b3b9-179b-4600-ad41-3ea9a8d9aedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7413ac9-e48b-4f68-bc89-e6f9b7b5edc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7413ac9-e48b-4f68-bc89-e6f9b7b5edc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-295079379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42946ebc-a370-413c-9d1a-8ba80682c3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55dbe6fa0d045d586f8d0d676efcf2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:10Z,use_quota=True,user_id='813d6ffd490941ea8f194c177069bdd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ab145f-c536-4269-b31b-2a1827e22145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ab145f-c536-4269-b31b-2a1827e22145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2cd0e9a-02b0-4038-ab37-d3a792efd42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2cd0e9a-02b0-4038-ab37-d3a792efd42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42946ebc-a370-413c-9d1a-8ba80682c3cd', 'volume_name': 'volume-42946ebc-a370-413c-9d1a-8ba80682c3cd', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f6ae43-b854-4b3d-8f2d-be5472860a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53f6ae43-b854-4b3d-8f2d-be5472860a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c41ce1-3bbf-43f2-9eeb-476eb5aebcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:10 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Volume 42946ebc-a370-413c-9d1a-8ba80682c3cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42946ebc-a370-413c-9d1a-8ba80682c3cd', 'volume_size': 1} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-295079379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42946ebc-a370-413c-9d1a-8ba80682c3cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55dbe6fa0d045d586f8d0d676efcf2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:10Z,use_quota=True,user_id='813d6ffd490941ea8f194c177069bdd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Creating volume 42946ebc-a370-413c-9d1a-8ba80682c3cd {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:53:10 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:10 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd 1073741824 Nov 05 03:53:10 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:10 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9a059a5e-7e31-4db3-8bcd-21a77404eb7b tempest-TestServerVolumeAttachmentScenario-1363121332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-62ceaea1-798e-468f-a143-1c0f101f8d38" returned: 0 in 0.395s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9a059a5e-7e31-4db3-8bcd-21a77404eb7b tempest-TestServerVolumeAttachmentScenario-1363121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-62ceaea1-798e-468f-a143-1c0f101f8d38 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:10 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-62ceaea1-798e-468f-a143-1c0f101f8d38 Nov 05 03:53:10 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:10 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9a059a5e-7e31-4db3-8bcd-21a77404eb7b tempest-TestServerVolumeAttachmentScenario-1363121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-62ceaea1-798e-468f-a143-1c0f101f8d38" returned: 0 in 0.361s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9a059a5e-7e31-4db3-8bcd-21a77404eb7b tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "cinder-quobyte-62ceaea1-798e-468f-a143-1c0f101f8d38" released by "delete_volume" :: held 0.807s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:10 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd 1073741824" returned: 0 in 0.575s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-9a059a5e-7e31-4db3-8bcd-21a77404eb7b tempest-TestServerVolumeAttachmentScenario-1363121332 None] Created reservations ['845fa338-cc50-43db-8d4d-a4caff42e51f', '7e393ba7-1747-4836-8d2d-db9faea637a0', 'ffe1f59e-7126-4f7a-a79c-2c461e0effbc', 'a91eaf1c-ccbd-41a4-a07b-7aeb0cb60e55'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:10 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd Nov 05 03:53:10 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9a059a5e-7e31-4db3-8bcd-21a77404eb7b tempest-TestServerVolumeAttachmentScenario-1363121332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9a059a5e-7e31-4db3-8bcd-21a77404eb7b tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9a059a5e-7e31-4db3-8bcd-21a77404eb7b tempest-TestServerVolumeAttachmentScenario-1363121332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9a059a5e-7e31-4db3-8bcd-21a77404eb7b tempest-TestServerVolumeAttachmentScenario-1363121332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9a059a5e-7e31-4db3-8bcd-21a77404eb7b tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9a059a5e-7e31-4db3-8bcd-21a77404eb7b tempest-TestServerVolumeAttachmentScenario-1363121332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:10 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:53:10 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:11 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd" returned: 0 in 0.374s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:11 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:53:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c41ce1-3bbf-43f2-9eeb-476eb5aebcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42946ebc-a370-413c-9d1a-8ba80682c3cd', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7f8acd-1031-4be0-915e-2ffcd0e5b840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:11 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:11 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Volume volume-42946ebc-a370-413c-9d1a-8ba80682c3cd (42946ebc-a370-413c-9d1a-8ba80682c3cd): created successfully Nov 05 03:53:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7f8acd-1031-4be0-915e-2ffcd0e5b840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Flow 'volume_create_manager' (9398b3b9-179b-4600-ad41-3ea9a8d9aedd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9a059a5e-7e31-4db3-8bcd-21a77404eb7b tempest-TestServerVolumeAttachmentScenario-1363121332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.334s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:11 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-9a059a5e-7e31-4db3-8bcd-21a77404eb7b tempest-TestServerVolumeAttachmentScenario-1363121332 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:11 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-9a059a5e-7e31-4db3-8bcd-21a77404eb7b tempest-TestServerVolumeAttachmentScenario-1363121332 None] Deleted volume successfully. Nov 05 03:53:11 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-098443ce-c67b-486d-a1f8-9cfa472180ee tempest-VolumesSnapshotTestJSON-1837012040 None] Created volume successfully. Nov 05 03:53:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9a059a5e-7e31-4db3-8bcd-21a77404eb7b tempest-TestServerVolumeAttachmentScenario-1363121332 None] Lock "cinder-62ceaea1-798e-468f-a143-1c0f101f8d38-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-fb3a66b5-0f67-4bb7-b243-af9a0a25b8ce tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-fb3a66b5-0f67-4bb7-b243-af9a0a25b8ce tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-fb3a66b5-0f67-4bb7-b243-af9a0a25b8ce tempest-VolumesSnapshotTestJSON-1837012040 None] Creating offline snapshot 856596b6-a141-4908-9e66-5184d307fa9b of volume 42946ebc-a370-413c-9d1a-8ba80682c3cd {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:53:12 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d09c187-5412-4853-b435-d56fc3f150a0]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fb3a66b5-0f67-4bb7-b243-af9a0a25b8ce tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:13 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd Nov 05 03:53:13 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:13 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fb3a66b5-0f67-4bb7-b243-af9a0a25b8ce tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd" returned: 0 in 0.457s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fb3a66b5-0f67-4bb7-b243-af9a0a25b8ce tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.856596b6-a141-4908-9e66-5184d307fa9b 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:13 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.856596b6-a141-4908-9e66-5184d307fa9b 1G Nov 05 03:53:13 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:13 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fb3a66b5-0f67-4bb7-b243-af9a0a25b8ce tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.856596b6-a141-4908-9e66-5184d307fa9b 1G" returned: 0 in 0.494s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fb3a66b5-0f67-4bb7-b243-af9a0a25b8ce tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42946ebc-a370-413c-9d1a-8ba80682c3cd -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.856596b6-a141-4908-9e66-5184d307fa9b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:13 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42946ebc-a370-413c-9d1a-8ba80682c3cd -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.856596b6-a141-4908-9e66-5184d307fa9b Nov 05 03:53:13 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:13 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Flow 'volume_create_manager' (707e8231-d448-4110-9f2a-ae1ae206877f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c677ec8-94c4-4345-bbda-e29c7d689cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c677ec8-94c4-4345-bbda-e29c7d689cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-195577011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3c7284-ddf5-4cd5-97fb-30e883d94bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6501ce66abff4283baa7262d222ff396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:14Z,use_quota=True,user_id='5b9d8dbdc1964480a02b097dd9b8bc3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d892c1a3-230b-48b8-8e6c-febd4a5681a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d892c1a3-230b-48b8-8e6c-febd4a5681a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d9d0a1-2602-4af0-b77d-bc8df38f4fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2d9d0a1-2602-4af0-b77d-bc8df38f4fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b3c7284-ddf5-4cd5-97fb-30e883d94bde', 'volume_name': 'volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8614859-c3c2-4bcc-9cd1-f3fae3f327d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8614859-c3c2-4bcc-9cd1-f3fae3f327d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5761da98-9feb-4df7-952e-89058699f513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:14 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Volume 3b3c7284-ddf5-4cd5-97fb-30e883d94bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde', 'volume_size': 1} Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:14 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fb3a66b5-0f67-4bb7-b243-af9a0a25b8ce tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42946ebc-a370-413c-9d1a-8ba80682c3cd -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.856596b6-a141-4908-9e66-5184d307fa9b" returned: 0 in 0.320s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:14 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-fb3a66b5-0f67-4bb7-b243-af9a0a25b8ce tempest-VolumesSnapshotTestJSON-1837012040 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.856596b6-a141-4908-9e66-5184d307fa9b is being set with open permissions: ugo+rw Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fb3a66b5-0f67-4bb7-b243-af9a0a25b8ce tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.856596b6-a141-4908-9e66-5184d307fa9b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:14 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.856596b6-a141-4908-9e66-5184d307fa9b Nov 05 03:53:14 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:14 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fb3a66b5-0f67-4bb7-b243-af9a0a25b8ce tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.856596b6-a141-4908-9e66-5184d307fa9b" returned: 0 in 0.230s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fb3a66b5-0f67-4bb7-b243-af9a0a25b8ce tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:14 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.info Nov 05 03:53:14 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:14 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fb3a66b5-0f67-4bb7-b243-af9a0a25b8ce tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.info" returned: 0 in 0.239s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:14 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-fb3a66b5-0f67-4bb7-b243-af9a0a25b8ce tempest-VolumesSnapshotTestJSON-1837012040 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.info is being set with open permissions: ugo+rw Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fb3a66b5-0f67-4bb7-b243-af9a0a25b8ce tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:14 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.info Nov 05 03:53:14 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:14 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fb3a66b5-0f67-4bb7-b243-af9a0a25b8ce tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.info" returned: 0 in 0.247s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-fb3a66b5-0f67-4bb7-b243-af9a0a25b8ce tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.086s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.898s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-195577011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3c7284-ddf5-4cd5-97fb-30e883d94bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6501ce66abff4283baa7262d222ff396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:14Z,use_quota=True,user_id='5b9d8dbdc1964480a02b097dd9b8bc3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Creating volume 3b3c7284-ddf5-4cd5-97fb-30e883d94bde {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:53:14 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:53:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:14 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde 1073741824 Nov 05 03:53:14 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:15 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-fb3a66b5-0f67-4bb7-b243-af9a0a25b8ce tempest-VolumesSnapshotTestJSON-1837012040 None] Create snapshot completed successfully Nov 05 03:53:15 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde 1073741824" returned: 0 in 0.501s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:15 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde Nov 05 03:53:15 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:15 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde" returned: 0 in 0.250s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:53:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5761da98-9feb-4df7-952e-89058699f513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ab630b-9870-48ce-b8a9-26a192a5f0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:15 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Volume volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde (3b3c7284-ddf5-4cd5-97fb-30e883d94bde): created successfully Nov 05 03:53:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ab630b-9870-48ce-b8a9-26a192a5f0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Flow 'volume_create_manager' (707e8231-d448-4110-9f2a-ae1ae206877f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:15 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-705398c3-2f6b-45de-b065-e6951911dd27 tempest-VolumesDeleteCascade-157076980 None] Created volume successfully. Nov 05 03:53:16 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-856596b6-a141-4908-9e66-5184d307fa9b-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:16 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-856596b6-a141-4908-9e66-5184d307fa9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0a3dfe17-75a3-4ad1-b29a-ffee6a5d3ae7 tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0a3dfe17-75a3-4ad1-b29a-ffee6a5d3ae7 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-0a3dfe17-75a3-4ad1-b29a-ffee6a5d3ae7 tempest-VolumesDeleteCascade-157076980 None] Creating offline snapshot 63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 of volume 3b3c7284-ddf5-4cd5-97fb-30e883d94bde {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:53:16 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-quobyte-42946ebc-a370-413c-9d1a-8ba80682c3cd" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:16 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-42946ebc-a370-413c-9d1a-8ba80682c3cd" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:16 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-quobyte-856596b6-a141-4908-9e66-5184d307fa9b" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:16 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d8b54a-21b4-4167-ab63-421a06723b2d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a3dfe17-75a3-4ad1-b29a-ffee6a5d3ae7 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:16 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-856596b6-a141-4908-9e66-5184d307fa9b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] Deleting offline snapshot 856596b6-a141-4908-9e66-5184d307fa9b of volume 42946ebc-a370-413c-9d1a-8ba80682c3cd {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:53:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] snapshot_file for this snap is: volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.856596b6-a141-4908-9e66-5184d307fa9b {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:53:16 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbac130-cab0-44ab-a217-17e7ebf02bd2]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.856596b6-a141-4908-9e66-5184d307fa9b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:16 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde Nov 05 03:53:16 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:16 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.856596b6-a141-4908-9e66-5184d307fa9b Nov 05 03:53:16 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:16 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a3dfe17-75a3-4ad1-b29a-ffee6a5d3ae7 tempest-VolumesDeleteCascade-157076980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde" returned: 0 in 0.435s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a3dfe17-75a3-4ad1-b29a-ffee6a5d3ae7 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:16 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.856596b6-a141-4908-9e66-5184d307fa9b" returned: 0 in 0.399s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42946ebc-a370-413c-9d1a-8ba80682c3cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:53:16 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 1G Nov 05 03:53:16 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:16 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[42798808-b33d-4391-8147-1f42913c8a77]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:17 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd Nov 05 03:53:17 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:17 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd" returned: 0 in 0.426s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.856596b6-a141-4908-9e66-5184d307fa9b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:17 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a3dfe17-75a3-4ad1-b29a-ffee6a5d3ae7 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 1G" returned: 0 in 0.511s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a3dfe17-75a3-4ad1-b29a-ffee6a5d3ae7 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:17 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.856596b6-a141-4908-9e66-5184d307fa9b Nov 05 03:53:17 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:17 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 Nov 05 03:53:17 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:17 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a3dfe17-75a3-4ad1-b29a-ffee6a5d3ae7 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1" returned: 0 in 0.293s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:17 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-0a3dfe17-75a3-4ad1-b29a-ffee6a5d3ae7 tempest-VolumesDeleteCascade-157076980 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 is being set with open permissions: ugo+rw Nov 05 03:53:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a3dfe17-75a3-4ad1-b29a-ffee6a5d3ae7 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:17 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 Nov 05 03:53:17 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:17 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.856596b6-a141-4908-9e66-5184d307fa9b" returned: 0 in 0.383s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.856596b6-a141-4908-9e66-5184d307fa9b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:17 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.856596b6-a141-4908-9e66-5184d307fa9b Nov 05 03:53:17 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:17 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a3dfe17-75a3-4ad1-b29a-ffee6a5d3ae7 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1" returned: 0 in 0.276s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a3dfe17-75a3-4ad1-b29a-ffee6a5d3ae7 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:17 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.info Nov 05 03:53:17 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:17 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd.856596b6-a141-4908-9e66-5184d307fa9b" returned: 0 in 0.287s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:18 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-856596b6-a141-4908-9e66-5184d307fa9b" released by "_delete_snapshot" :: held 1.637s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:18 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-42946ebc-a370-413c-9d1a-8ba80682c3cd" released by "delete_snapshot" :: held 1.666s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:18 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] Created reservations ['22d6d959-e17c-4f63-902a-0354fa522b00', '3c208683-67cf-4727-bf35-e1ce8879a03f', '1b54e33f-271d-409d-8c74-0c4a13fe3086', 'e74959e7-44c9-4a66-960b-58f4ec3f2e43'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:18 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] Delete snapshot completed successfully. Nov 05 03:53:18 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f00bd4c6-5b49-4f32-8533-d010c7b8398c tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-856596b6-a141-4908-9e66-5184d307fa9b-delete_snapshot" released by "delete_snapshot" :: held 1.903s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:18 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a3dfe17-75a3-4ad1-b29a-ffee6a5d3ae7 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.info" returned: 0 in 0.288s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:18 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-0a3dfe17-75a3-4ad1-b29a-ffee6a5d3ae7 tempest-VolumesDeleteCascade-157076980 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.info is being set with open permissions: ugo+rw Nov 05 03:53:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a3dfe17-75a3-4ad1-b29a-ffee6a5d3ae7 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:18 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.info Nov 05 03:53:18 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:18 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a3dfe17-75a3-4ad1-b29a-ffee6a5d3ae7 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.info" returned: 0 in 0.288s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0a3dfe17-75a3-4ad1-b29a-ffee6a5d3ae7 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.204s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:18 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-0a3dfe17-75a3-4ad1-b29a-ffee6a5d3ae7 tempest-VolumesDeleteCascade-157076980 None] Create snapshot completed successfully Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Flow 'volume_create_manager' (68ca7899-4b4b-4880-9b6d-b421ea042212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20eb54a7-ccbf-4deb-bbc0-c6f03489896e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20eb54a7-ccbf-4deb-bbc0-c6f03489896e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-543502399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7513dc56-9fab-4ccf-82a1-aca965d3ef74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55dbe6fa0d045d586f8d0d676efcf2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:19Z,use_quota=True,user_id='813d6ffd490941ea8f194c177069bdd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d9d384-5472-4e69-907e-12dcb443e444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d9d384-5472-4e69-907e-12dcb443e444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec98f86-b2e8-4cc3-bb3f-49561e343617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aec98f86-b2e8-4cc3-bb3f-49561e343617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7513dc56-9fab-4ccf-82a1-aca965d3ef74', 'volume_name': 'volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2784808a-cb6b-4961-9e47-691bd963268d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2784808a-cb6b-4961-9e47-691bd963268d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714113ba-8b62-4980-9679-e63a3f753814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:19 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Volume 7513dc56-9fab-4ccf-82a1-aca965d3ef74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74', 'volume_size': 1} Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-543502399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7513dc56-9fab-4ccf-82a1-aca965d3ef74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55dbe6fa0d045d586f8d0d676efcf2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:19Z,use_quota=True,user_id='813d6ffd490941ea8f194c177069bdd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Creating volume 7513dc56-9fab-4ccf-82a1-aca965d3ef74 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:53:19 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:19 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 1073741824 Nov 05 03:53:19 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-dd42f020-db33-40d0-872b-20d9f9872faf tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:19 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 1073741824" returned: 0 in 0.515s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:19 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 Nov 05 03:53:19 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:20 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74" returned: 0 in 0.327s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:53:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-dd42f020-db33-40d0-872b-20d9f9872faf tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.387s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714113ba-8b62-4980-9679-e63a3f753814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3575132d-da0a-4765-818b-c520a03bf20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-dd42f020-db33-40d0-872b-20d9f9872faf tempest-VolumesDeleteCascade-157076980 None] Creating offline snapshot a6dd2229-0f62-4398-b35a-742d7e5f7657 of volume 3b3c7284-ddf5-4cd5-97fb-30e883d94bde {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:53:20 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c369fb4d-ccfc-43fe-9a20-ef70e9f72340]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dd42f020-db33-40d0-872b-20d9f9872faf tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:20 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Volume volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 (7513dc56-9fab-4ccf-82a1-aca965d3ef74): created successfully Nov 05 03:53:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3575132d-da0a-4765-818b-c520a03bf20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Flow 'volume_create_manager' (68ca7899-4b4b-4880-9b6d-b421ea042212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:20 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-e1e6fa11-9e76-4529-b383-36a4fbc4572d tempest-VolumesSnapshotTestJSON-1837012040 None] Created volume successfully. Nov 05 03:53:20 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 Nov 05 03:53:20 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:20 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dd42f020-db33-40d0-872b-20d9f9872faf tempest-VolumesDeleteCascade-157076980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1" returned: 0 in 0.388s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-dd42f020-db33-40d0-872b-20d9f9872faf tempest-VolumesDeleteCascade-157076980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:53:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dd42f020-db33-40d0-872b-20d9f9872faf tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:20 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657 1G Nov 05 03:53:20 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:21 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dd42f020-db33-40d0-872b-20d9f9872faf tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657 1G" returned: 0 in 0.499s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dd42f020-db33-40d0-872b-20d9f9872faf tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:21 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657 Nov 05 03:53:21 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:21 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dd42f020-db33-40d0-872b-20d9f9872faf tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657" returned: 0 in 0.364s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:21 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-dd42f020-db33-40d0-872b-20d9f9872faf tempest-VolumesDeleteCascade-157076980 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657 is being set with open permissions: ugo+rw Nov 05 03:53:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dd42f020-db33-40d0-872b-20d9f9872faf tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:21 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657 Nov 05 03:53:21 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d8e8fefe-22ff-4040-ab65-e4c411d7a6b2 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:21 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dd42f020-db33-40d0-872b-20d9f9872faf tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657" returned: 0 in 0.280s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-dd42f020-db33-40d0-872b-20d9f9872faf tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.685s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d8e8fefe-22ff-4040-ab65-e4c411d7a6b2 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.281s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-d8e8fefe-22ff-4040-ab65-e4c411d7a6b2 tempest-VolumesSnapshotTestJSON-1837012040 None] Creating offline snapshot 312fbe6f-9f04-4704-9246-9e8c65de9bcb of volume 7513dc56-9fab-4ccf-82a1-aca965d3ef74 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:53:21 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-dd42f020-db33-40d0-872b-20d9f9872faf tempest-VolumesDeleteCascade-157076980 None] Create snapshot completed successfully Nov 05 03:53:21 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c26298c-a6f6-448e-80f2-b14f7f0660a8]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d8e8fefe-22ff-4040-ab65-e4c411d7a6b2 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:21 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 Nov 05 03:53:21 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:22 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d8e8fefe-22ff-4040-ab65-e4c411d7a6b2 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74" returned: 0 in 0.422s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d8e8fefe-22ff-4040-ab65-e4c411d7a6b2 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:22 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb 1G Nov 05 03:53:22 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:22 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d8e8fefe-22ff-4040-ab65-e4c411d7a6b2 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb 1G" returned: 0 in 0.462s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d8e8fefe-22ff-4040-ab65-e4c411d7a6b2 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:22 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb Nov 05 03:53:22 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "cinder-3b3c7284-ddf5-4cd5-97fb-30e883d94bde-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-3b3c7284-ddf5-4cd5-97fb-30e883d94bde-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Performing cascade delete. {{(pid=87109) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1000}} Nov 05 03:53:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "cinder-63e22c5a-5ba5-444a-9dff-7d2935e6c1e1-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-63e22c5a-5ba5-444a-9dff-7d2935e6c1e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "cinder-quobyte-3b3c7284-ddf5-4cd5-97fb-30e883d94bde" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:23 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-3b3c7284-ddf5-4cd5-97fb-30e883d94bde" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "cinder-quobyte-63e22c5a-5ba5-444a-9dff-7d2935e6c1e1" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d8e8fefe-22ff-4040-ab65-e4c411d7a6b2 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb" returned: 0 in 0.371s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:23 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-d8e8fefe-22ff-4040-ab65-e4c411d7a6b2 tempest-VolumesSnapshotTestJSON-1837012040 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb is being set with open permissions: ugo+rw Nov 05 03:53:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d8e8fefe-22ff-4040-ab65-e4c411d7a6b2 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-63e22c5a-5ba5-444a-9dff-7d2935e6c1e1" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:23 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb Nov 05 03:53:23 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Deleting offline snapshot 63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 of volume 3b3c7284-ddf5-4cd5-97fb-30e883d94bde {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:53:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] snapshot_file for this snap is: volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:53:23 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fc284f-6841-44f7-9072-39a9fb4e63e8]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:23 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 Nov 05 03:53:23 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:23 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d8e8fefe-22ff-4040-ab65-e4c411d7a6b2 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb" returned: 0 in 0.278s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d8e8fefe-22ff-4040-ab65-e4c411d7a6b2 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:23 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.info Nov 05 03:53:23 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:23 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1" returned: 0 in 0.436s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:53:23 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d8996b-bbea-4189-b177-008f12c56ff9]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:23 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d8e8fefe-22ff-4040-ab65-e4c411d7a6b2 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.info" returned: 0 in 0.301s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:23 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-d8e8fefe-22ff-4040-ab65-e4c411d7a6b2 tempest-VolumesSnapshotTestJSON-1837012040 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.info is being set with open permissions: ugo+rw Nov 05 03:53:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d8e8fefe-22ff-4040-ab65-e4c411d7a6b2 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:23 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.info Nov 05 03:53:23 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:23 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde Nov 05 03:53:23 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:23 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d8e8fefe-22ff-4040-ab65-e4c411d7a6b2 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.info" returned: 0 in 0.277s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d8e8fefe-22ff-4040-ab65-e4c411d7a6b2 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.241s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:24 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-d8e8fefe-22ff-4040-ab65-e4c411d7a6b2 tempest-VolumesSnapshotTestJSON-1837012040 None] Create snapshot completed successfully Nov 05 03:53:24 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde" returned: 0 in 0.467s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:24 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5aa28c-83cc-4777-bd8c-33bc6dcecc7e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:24 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657 Nov 05 03:53:24 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:24 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657" returned: 0 in 0.391s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:24 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:53:24 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e29642-11bf-4863-9f52-0c5c8d302c0d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:24 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 Nov 05 03:53:24 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:24 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1" returned: 0 in 0.432s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4a7a94-4055-44e0-82bc-b9e4ffd27c8a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:25 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde Nov 05 03:53:25 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Flow 'volume_create_manager' (fc907edc-be34-4b5f-b591-42432b157f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e29712-5102-42fd-984d-83e18358e500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e29712-5102-42fd-984d-83e18358e500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-991215989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78fc0f82-aecb-406f-b84a-bc5da4a8a6e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55dbe6fa0d045d586f8d0d676efcf2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=312fbe6f-9f04-4704-9246-9e8c65de9bcb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:25Z,use_quota=True,user_id='813d6ffd490941ea8f194c177069bdd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e60a1fc-9813-45b0-a949-132b82ff1f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e60a1fc-9813-45b0-a949-132b82ff1f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ebf636f-f74d-490f-84b3-aabdee96f69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ebf636f-f74d-490f-84b3-aabdee96f69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '78fc0f82-aecb-406f-b84a-bc5da4a8a6e7', 'volume_name': 'volume-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7', 'volume_size': 2, 'snapshot_id': '312fbe6f-9f04-4704-9246-9e8c65de9bcb'}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (179150d4-5ce5-4657-86b6-f5c362e2585c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (179150d4-5ce5-4657-86b6-f5c362e2585c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8589ff-ea0f-4e63-8fba-39f4af9c05ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:25 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Volume 78fc0f82-aecb-406f-b84a-bc5da4a8a6e7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7', 'volume_size': 2, 'snapshot_id': '312fbe6f-9f04-4704-9246-9e8c65de9bcb'} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-quobyte-312fbe6f-9f04-4704-9246-9e8c65de9bcb-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7" by "_create_volume_from_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-312fbe6f-9f04-4704-9246-9e8c65de9bcb-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Creating volume 78fc0f82-aecb-406f-b84a-bc5da4a8a6e7 from snapshot 312fbe6f-9f04-4704-9246-9e8c65de9bcb {{(pid=87109) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-quobyte-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7" by "_copy_volume_from_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:25 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde" returned: 0 in 0.527s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] snapshot: 312fbe6f-9f04-4704-9246-9e8c65de9bcb, volume: 78fc0f82-aecb-406f-b84a-bc5da4a8a6e7, {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 03:53:25 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 Nov 05 03:53:25 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[812c0d9f-1d90-4ba1-836e-5b077b77c299]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:25 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb Nov 05 03:53:25 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:25 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1" returned: 0 in 0.383s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:25 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1 Nov 05 03:53:25 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:26 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb" returned: 0 in 0.434s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0f56d5-9f04-4a45-80ad-7eb9ec89bb48]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:26 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 Nov 05 03:53:26 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:26 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.63e22c5a-5ba5-444a-9dff-7d2935e6c1e1" returned: 0 in 0.306s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657 -F qcow2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:26 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657 -F qcow2 Nov 05 03:53:26 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:26 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74" returned: 0 in 0.446s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Creating direct copy from snapshot {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG cinder.utils [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Path /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7 not found in is_blk_device check {{(pid=87109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:26 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7 Nov 05 03:53:26 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:26 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657 -F qcow2" returned: 0 in 0.356s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-63e22c5a-5ba5-444a-9dff-7d2935e6c1e1" released by "_delete_snapshot" :: held 3.544s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-3b3c7284-ddf5-4cd5-97fb-30e883d94bde" released by "delete_snapshot" :: held 3.586s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Created reservations ['017bc451-6640-4704-86a2-06fa5d1f95ee', '2f758768-871a-449a-a368-2f01de95f130', 'bb115aee-633b-42fb-8a05-46cc3b9fb709', 'ec54c231-6115-4239-967a-c16310483d5b'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:26 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Delete snapshot completed successfully. Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-63e22c5a-5ba5-444a-9dff-7d2935e6c1e1-delete_snapshot" released by "delete_snapshot" :: held 3.777s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "cinder-a6dd2229-0f62-4398-b35a-742d7e5f7657-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-a6dd2229-0f62-4398-b35a-742d7e5f7657-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "cinder-quobyte-3b3c7284-ddf5-4cd5-97fb-30e883d94bde" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-3b3c7284-ddf5-4cd5-97fb-30e883d94bde" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "cinder-quobyte-a6dd2229-0f62-4398-b35a-742d7e5f7657" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-a6dd2229-0f62-4398-b35a-742d7e5f7657" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Deleting offline snapshot a6dd2229-0f62-4398-b35a-742d7e5f7657 of volume 3b3c7284-ddf5-4cd5-97fb-30e883d94bde {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] snapshot_file for this snap is: volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22ecb53-6585-4d9e-889b-1131cdf9b42f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:27 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657 Nov 05 03:53:27 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:27 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657" returned: 0 in 0.637s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:27 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:53:27 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfd6fbf-1e50-44a0-87bc-cc412640ead9]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:27 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde Nov 05 03:53:27 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:28 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde" returned: 0 in 0.653s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:28 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657 Nov 05 03:53:28 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:29 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657" returned: 0 in 0.777s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:29 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657 Nov 05 03:53:29 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:29 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde.a6dd2229-0f62-4398-b35a-742d7e5f7657" returned: 0 in 0.608s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-a6dd2229-0f62-4398-b35a-742d7e5f7657" released by "_delete_snapshot" :: held 2.876s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-3b3c7284-ddf5-4cd5-97fb-30e883d94bde" released by "delete_snapshot" :: held 2.919s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:29 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=120,cinder:UPDATE=108,cinder:DELETE=12,cinder:INSERT=37 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:53:29 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Created reservations ['8cd119f4-6876-4307-b5df-4bbbfcd32a99', '4d3db100-7ba2-43d7-b437-7eb84a2643c3', '76939431-3f23-4828-a364-0ec6b0f45f7a', '31e4c26d-990c-4833-8a1f-d9be87915d92'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:30 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Delete snapshot completed successfully. Nov 05 03:53:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-a6dd2229-0f62-4398-b35a-742d7e5f7657-delete_snapshot" released by "delete_snapshot" :: held 3.334s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Snapshots deleted, issuing volume delete {{(pid=87109) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1015}} Nov 05 03:53:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "cinder-quobyte-3b3c7284-ddf5-4cd5-97fb-30e883d94bde" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-3b3c7284-ddf5-4cd5-97fb-30e883d94bde" acquired by "delete_volume" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:30 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b8dece-7711-4fdf-8ede-6ac71b694790]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:30 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Flow 'volume_create_manager' (3ffbe719-823e-45f9-a18d-c6bb2d962b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7e147b-6133-4fbc-bc7f-e59607e5b146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff7e147b-6133-4fbc-bc7f-e59607e5b146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e37e6b-14e6-4067-b45a-4a2ea320a690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='501792421819490f9e0adf98b42ee2a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:30Z,use_quota=True,user_id='0aef325819e74c5693fd37beb72658e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c582a06-5a2b-41b7-8e6a-1e45de154fc6),volume_type_id=7c582a06-5a2b-41b7-8e6a-1e45de154fc6)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26780ce9-62d9-4c68-a50e-c194fe452fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26780ce9-62d9-4c68-a50e-c194fe452fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d00fb56-f614-4a9a-a3da-ff1562611ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:30 devstack cinder-volume[87109]: DEBUG cinder.image.glance [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Creating Keystone auth plugin from conf {{(pid=87109) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 03:53:30 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde Nov 05 03:53:30 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d00fb56-f614-4a9a-a3da-ff1562611ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c1e37e6b-14e6-4067-b45a-4a2ea320a690', 'volume_name': 'volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690', 'volume_size': 1, 'image_id': '3effbe7c-54e4-4d92-9b61-0e3889ee5b2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3effbe7c-54e4-4d92-9b61-0e3889ee5b2e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '49479330a1780b7161cb6be5a321f803', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '501792421819490f9e0adf98b42ee2a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '606848d7b3cd7e31a2febe0051a6c8b2ed46162a88cbe37d1b74b38b19092f15e2e6f6256d7cf230db83c00df3c5ca5cee480e4fe9a73ed7b0f1eb2d643fad65', 'id': '3effbe7c-54e4-4d92-9b61-0e3889ee5b2e', 'created_at': datetime.datetime(2026, 11, 5, 2, 53, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 53, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3effbe7c-54e4-4d92-9b61-0e3889ee5b2e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07b3715-b3e5-4cf2-a502-a44b26e65178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07b3715-b3e5-4cf2-a502-a44b26e65178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7f3a99-468c-47c0-abf2-011455766e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:31 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Volume c1e37e6b-14e6-4067-b45a-4a2ea320a690: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690', 'volume_size': 1, 'image_id': '3effbe7c-54e4-4d92-9b61-0e3889ee5b2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3effbe7c-54e4-4d92-9b61-0e3889ee5b2e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '49479330a1780b7161cb6be5a321f803', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '501792421819490f9e0adf98b42ee2a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '606848d7b3cd7e31a2febe0051a6c8b2ed46162a88cbe37d1b74b38b19092f15e2e6f6256d7cf230db83c00df3c5ca5cee480e4fe9a73ed7b0f1eb2d643fad65', 'id': '3effbe7c-54e4-4d92-9b61-0e3889ee5b2e', 'created_at': datetime.datetime(2026, 11, 5, 2, 53, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 53, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3effbe7c-54e4-4d92-9b61-0e3889ee5b2e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 03:53:31 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Trying to clone c1e37e6b-14e6-4067-b45a-4a2ea320a690 from image 3effbe7c-54e4-4d92-9b61-0e3889ee5b2e at location (None, [{'url': 'file:///opt/stack/data/glance/images/3effbe7c-54e4-4d92-9b61-0e3889ee5b2e', 'metadata': {}}]). {{(pid=87109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 03:53:31 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde" returned: 0 in 0.933s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:31 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 05 03:53:31 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Image download 0.00 MB at 0.00 MB/s Nov 05 03:53:31 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde Nov 05 03:53:31 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:31 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2811f2ca-ffd0-4fd5-903d-7a8ae490a478]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:31 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD Nov 05 03:53:31 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:31 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-3b3c7284-ddf5-4cd5-97fb-30e883d94bde" returned: 0 in 0.427s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-3b3c7284-ddf5-4cd5-97fb-30e883d94bde" released by "delete_volume" :: held 1.530s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:31 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=137,cinder:UPDATE=125,cinder:INSERT=32,cinder:DELETE=9 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:53:31 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Created reservations ['08954435-4345-4805-ae44-5bf0c6e27f52', 'c9634ec8-2faf-42dc-be2a-40c50db2ee17', 'd8dc539f-d986-4d4c-9496-49df0b29f37a', '24b19416-551b-49d9-99d1-c100cef8d88c'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:32 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:53:32 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:32 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD" returned: 0 in 0.785s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:32 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD Nov 05 03:53:32 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:32 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.549s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:32 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:32 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Deleted volume successfully. Nov 05 03:53:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-871dc857-2125-431c-ac57-bc1969fe2e3d tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-3b3c7284-ddf5-4cd5-97fb-30e883d94bde-delete_volume" released by "delete_volume" :: held 9.642s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:32 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD" returned: 1 in 0.580s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:53:32 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Temporary image 3effbe7c-54e4-4d92-9b61-0e3889ee5b2e is fetched for user 0aef325819e74c5693fd37beb72658e8. {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 05 03:53:32 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe50991-77ca-43bd-9037-cd360be61947]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:33 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD Nov 05 03:53:33 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:33 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD" returned: 0 in 0.614s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:33 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD Nov 05 03:53:33 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:34 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7" returned: 0 in 7.447s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Image conversion details: src /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74, size 1024.00 MB, duration 7.45 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7 {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:53:34 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Converted 1024.00 MB image at 137.49 MB/s Nov 05 03:53:34 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7 is being set with open permissions: ugo+rw Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:34 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7 Nov 05 03:53:34 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:34 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Flow 'volume_create_manager' (dc32dd5b-5b14-4097-9a0f-75684e2f376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abaa4d42-2079-4cc7-bb8d-a3b1cd21e4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD" returned: 1 in 0.535s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abaa4d42-2079-4cc7-bb8d-a3b1cd21e4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-491409853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8db0967-3b7c-4a23-b0bf-e7a935043d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6501ce66abff4283baa7262d222ff396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:34Z,use_quota=True,user_id='5b9d8dbdc1964480a02b097dd9b8bc3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fcb69ba-a8a0-484f-beb1-32ee73423d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fcb69ba-a8a0-484f-beb1-32ee73423d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2f4c83-4949-4aff-8474-dc74d00f1f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2f4c83-4949-4aff-8474-dc74d00f1f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8db0967-3b7c-4a23-b0bf-e7a935043d91', 'volume_name': 'volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb3b157-45cc-4110-9835-99efc0df918f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb3b157-45cc-4110-9835-99efc0df918f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2270a033-31f2-4c83-abd8-8e3959445aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:34 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Volume d8db0967-3b7c-4a23-b0bf-e7a935043d91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91', 'volume_size': 1} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:34 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7" returned: 0 in 0.245s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7" released by "_copy_volume_from_snapshot" :: held 8.691s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-312fbe6f-9f04-4704-9246-9e8c65de9bcb-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7" released by "_create_volume_from_snapshot" :: held 8.778s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.797s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.217s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e37e6b-14e6-4067-b45a-4a2ea320a690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='501792421819490f9e0adf98b42ee2a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:30Z,use_quota=True,user_id='0aef325819e74c5693fd37beb72658e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c582a06-5a2b-41b7-8e6a-1e45de154fc6),volume_type_id=7c582a06-5a2b-41b7-8e6a-1e45de154fc6)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Creating volume c1e37e6b-14e6-4067-b45a-4a2ea320a690 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:53:34 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:34 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690 1073741824 Nov 05 03:53:34 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8589ff-ea0f-4e63-8fba-39f4af9c05ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7', 'volume_size': 2, 'snapshot_id': '312fbe6f-9f04-4704-9246-9e8c65de9bcb'}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6942ce-9eab-4fd9-9bbd-ed7b8fff0cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:34 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Volume volume-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7 (78fc0f82-aecb-406f-b84a-bc5da4a8a6e7): created successfully Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d6942ce-9eab-4fd9-9bbd-ed7b8fff0cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Flow 'volume_create_manager' (fc907edc-be34-4b5f-b591-42432b157f5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:34 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-59dab557-a567-4f44-9a92-87438d23704e tempest-VolumesSnapshotTestJSON-1837012040 None] Created volume successfully. Nov 05 03:53:34 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690 1073741824" returned: 0 in 0.423s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:34 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690 Nov 05 03:53:34 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:35 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690" returned: 0 in 0.247s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.880s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-491409853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8db0967-3b7c-4a23-b0bf-e7a935043d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6501ce66abff4283baa7262d222ff396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:34Z,use_quota=True,user_id='5b9d8dbdc1964480a02b097dd9b8bc3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Creating volume d8db0967-3b7c-4a23-b0bf-e7a935043d91 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:53:35 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:35 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 1073741824 Nov 05 03:53:35 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Attempting download of 3effbe7c-54e4-4d92-9b61-0e3889ee5b2e ((None, [{'url': 'file:///opt/stack/data/glance/images/3effbe7c-54e4-4d92-9b61-0e3889ee5b2e', 'metadata': {}}])) to volume c1e37e6b-14e6-4067-b45a-4a2ea320a690. {{(pid=87109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7da33d0-d8fe-4caf-ab46-9b5bf48a721c]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_umgy12nd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:35 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_umgy12nd Nov 05 03:53:35 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:35 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_umgy12nd" returned: 0 in 0.384s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_umgy12nd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ca333775-87b3-4970-9421-de30545f4e92 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:35 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 1073741824" returned: 0 in 0.515s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ca333775-87b3-4970-9421-de30545f4e92 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:35 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 Nov 05 03:53:35 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ca333775-87b3-4970-9421-de30545f4e92 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-quobyte-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:35 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_umgy12nd Nov 05 03:53:35 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ca333775-87b3-4970-9421-de30545f4e92 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7" acquired by "delete_volume" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[466c3835-9687-42b1-a033-a0d0f5bc89e5]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ca333775-87b3-4970-9421-de30545f4e92 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:35 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7 Nov 05 03:53:35 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:35 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91" returned: 0 in 0.260s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:35 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2270a033-31f2-4c83-abd8-8e3959445aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53664069-5c29-4494-882a-d0059e4c1da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_umgy12nd" returned: 1 in 0.382s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_umgy12nd' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbd402b-dbcd-4ac1-af38-ca52b294e759]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:35 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Volume volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 (d8db0967-3b7c-4a23-b0bf-e7a935043d91): created successfully Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53664069-5c29-4494-882a-d0059e4c1da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Flow 'volume_create_manager' (dc32dd5b-5b14-4097-9a0f-75684e2f376e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:35 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-42e90d53-2165-4422-adfa-820e05fc8db3 tempest-VolumesDeleteCascade-157076980 None] Created volume successfully. Nov 05 03:53:36 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD Nov 05 03:53:36 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:36 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ca333775-87b3-4970-9421-de30545f4e92 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7" returned: 0 in 0.396s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ca333775-87b3-4970-9421-de30545f4e92 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:36 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7 Nov 05 03:53:36 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:36 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-947c394d-0a54-42b4-b710-cfbad2e4f804 tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-947c394d-0a54-42b4-b710-cfbad2e4f804 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-947c394d-0a54-42b4-b710-cfbad2e4f804 tempest-VolumesDeleteCascade-157076980 None] Creating offline snapshot 92c50241-2627-4e64-b165-6173e386636d of volume d8db0967-3b7c-4a23-b0bf-e7a935043d91 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[045ef055-4367-420d-8b53-351b5ed6e672]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-947c394d-0a54-42b4-b710-cfbad2e4f804 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:36 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ca333775-87b3-4970-9421-de30545f4e92 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7" returned: 0 in 0.280s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ca333775-87b3-4970-9421-de30545f4e92 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7" released by "delete_volume" :: held 0.727s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:36 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD Nov 05 03:53:36 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-ca333775-87b3-4970-9421-de30545f4e92 tempest-VolumesSnapshotTestJSON-1837012040 None] Created reservations ['3692bdf7-bb84-47b8-9ba9-a82b9b964d64', 'c8d83744-198e-4f70-887c-ffda68a48249', '43ca8b21-612c-4362-a278-31252a68863c', 'f05d923e-7b31-46dc-96fd-6ed82090c035'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:36 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 Nov 05 03:53:36 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ca333775-87b3-4970-9421-de30545f4e92 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ca333775-87b3-4970-9421-de30545f4e92 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ca333775-87b3-4970-9421-de30545f4e92 tempest-VolumesSnapshotTestJSON-1837012040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ca333775-87b3-4970-9421-de30545f4e92 tempest-VolumesSnapshotTestJSON-1837012040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ca333775-87b3-4970-9421-de30545f4e92 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ca333775-87b3-4970-9421-de30545f4e92 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:36 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:53:36 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:36 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD" returned: 1 in 0.362s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] 3effbe7c-54e4-4d92-9b61-0e3889ee5b2e was raw, converting to qcow2 {{(pid=87109) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:36 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690 Nov 05 03:53:36 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:36 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-947c394d-0a54-42b4-b710-cfbad2e4f804 tempest-VolumesDeleteCascade-157076980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91" returned: 0 in 0.452s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-947c394d-0a54-42b4-b710-cfbad2e4f804 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-312fbe6f-9f04-4704-9246-9e8c65de9bcb-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:36 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d 1G Nov 05 03:53:36 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-312fbe6f-9f04-4704-9246-9e8c65de9bcb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-quobyte-7513dc56-9fab-4ccf-82a1-aca965d3ef74" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-7513dc56-9fab-4ccf-82a1-aca965d3ef74" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-quobyte-312fbe6f-9f04-4704-9246-9e8c65de9bcb" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:36 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ca333775-87b3-4970-9421-de30545f4e92 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.346s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-ca333775-87b3-4970-9421-de30545f4e92 tempest-VolumesSnapshotTestJSON-1837012040 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:36 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-ca333775-87b3-4970-9421-de30545f4e92 tempest-VolumesSnapshotTestJSON-1837012040 None] Deleted volume successfully. Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-312fbe6f-9f04-4704-9246-9e8c65de9bcb" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] Deleting offline snapshot 312fbe6f-9f04-4704-9246-9e8c65de9bcb of volume 7513dc56-9fab-4ccf-82a1-aca965d3ef74 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] snapshot_file for this snap is: volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ca333775-87b3-4970-9421-de30545f4e92 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-78fc0f82-aecb-406f-b84a-bc5da4a8a6e7-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38a608c-5f51-40ce-ae95-c14cab8afec7]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:37 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb Nov 05 03:53:37 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:37 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690" returned: 0 in 0.560s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3effbe7c-54e4-4d92-9b61-0e3889ee5b2e_w4oqdxlodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690 {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:53:37 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:37 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690 1G Nov 05 03:53:37 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:37 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-947c394d-0a54-42b4-b710-cfbad2e4f804 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d 1G" returned: 0 in 0.504s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-947c394d-0a54-42b4-b710-cfbad2e4f804 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:37 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d Nov 05 03:53:37 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:37 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb" returned: 0 in 0.437s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f833453b-c67d-4373-a660-4206d4e338a7]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:37 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 Nov 05 03:53:37 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:37 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690 1G" returned: 0 in 0.355s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Downloaded image 3effbe7c-54e4-4d92-9b61-0e3889ee5b2e ((None, [{'url': 'file:///opt/stack/data/glance/images/3effbe7c-54e4-4d92-9b61-0e3889ee5b2e', 'metadata': {}}])) to volume c1e37e6b-14e6-4067-b45a-4a2ea320a690 successfully. {{(pid=87109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Temporary image 3effbe7c-54e4-4d92-9b61-0e3889ee5b2e for user 0aef325819e74c5693fd37beb72658e8 is deleted. {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Marking volume c1e37e6b-14e6-4067-b45a-4a2ea320a690 as bootable. {{(pid=87109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Copying metadata from image 3effbe7c-54e4-4d92-9b61-0e3889ee5b2e to c1e37e6b-14e6-4067-b45a-4a2ea320a690. {{(pid=87109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Creating volume glance metadata for volume c1e37e6b-14e6-4067-b45a-4a2ea320a690 backed by image 3effbe7c-54e4-4d92-9b61-0e3889ee5b2e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3effbe7c-54e4-4d92-9b61-0e3889ee5b2e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '49479330a1780b7161cb6be5a321f803', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 03:53:37 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-947c394d-0a54-42b4-b710-cfbad2e4f804 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d" returned: 0 in 0.350s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:37 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-947c394d-0a54-42b4-b710-cfbad2e4f804 tempest-VolumesDeleteCascade-157076980 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d is being set with open permissions: ugo+rw Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-947c394d-0a54-42b4-b710-cfbad2e4f804 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:37 devstack sudo[100648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d Nov 05 03:53:37 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7f3a99-468c-47c0-abf2-011455766e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690', 'volume_size': 1, 'image_id': '3effbe7c-54e4-4d92-9b61-0e3889ee5b2e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3effbe7c-54e4-4d92-9b61-0e3889ee5b2e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '49479330a1780b7161cb6be5a321f803', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '501792421819490f9e0adf98b42ee2a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '606848d7b3cd7e31a2febe0051a6c8b2ed46162a88cbe37d1b74b38b19092f15e2e6f6256d7cf230db83c00df3c5ca5cee480e4fe9a73ed7b0f1eb2d643fad65', 'id': '3effbe7c-54e4-4d92-9b61-0e3889ee5b2e', 'created_at': datetime.datetime(2026, 11, 5, 2, 53, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 53, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3effbe7c-54e4-4d92-9b61-0e3889ee5b2e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7e3287-dd4c-4407-ad70-767ccf29aafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:37 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Volume volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690 (c1e37e6b-14e6-4067-b45a-4a2ea320a690): created successfully Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7e3287-dd4c-4407-ad70-767ccf29aafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Flow 'volume_create_manager' (3ffbe719-823e-45f9-a18d-c6bb2d962b25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:37 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-3d00edeb-4e2a-4314-b773-359838cb9a00 tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Created volume successfully. Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Acquiring lock "cinder-c1e37e6b-14e6-4067-b45a-4a2ea320a690-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Lock "cinder-c1e37e6b-14e6-4067-b45a-4a2ea320a690-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:37 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-947c394d-0a54-42b4-b710-cfbad2e4f804 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d" returned: 0 in 0.308s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Acquiring lock "cinder-quobyte-c1e37e6b-14e6-4067-b45a-4a2ea320a690" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-947c394d-0a54-42b4-b710-cfbad2e4f804 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:38 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74" returned: 0 in 0.615s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:38 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.info Nov 05 03:53:38 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Lock "cinder-quobyte-c1e37e6b-14e6-4067-b45a-4a2ea320a690" acquired by "delete_volume" :: waited 0.046s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:38 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb Nov 05 03:53:38 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[688598b6-bed0-49fd-b703-a8d89e189538]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:38 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690 Nov 05 03:53:38 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:38 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-947c394d-0a54-42b4-b710-cfbad2e4f804 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.info" returned: 0 in 0.269s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:38 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-947c394d-0a54-42b4-b710-cfbad2e4f804 tempest-VolumesDeleteCascade-157076980 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.info is being set with open permissions: ugo+rw Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-947c394d-0a54-42b4-b710-cfbad2e4f804 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:38 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.info Nov 05 03:53:38 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:38 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb" returned: 0 in 0.364s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:38 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb Nov 05 03:53:38 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:38 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690" returned: 0 in 0.410s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:38 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690 Nov 05 03:53:38 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:38 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-947c394d-0a54-42b4-b710-cfbad2e4f804 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.info" returned: 0 in 0.275s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-947c394d-0a54-42b4-b710-cfbad2e4f804 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.276s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:38 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-947c394d-0a54-42b4-b710-cfbad2e4f804 tempest-VolumesDeleteCascade-157076980 None] Create snapshot completed successfully Nov 05 03:53:38 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74.312fbe6f-9f04-4704-9246-9e8c65de9bcb" returned: 0 in 0.272s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-312fbe6f-9f04-4704-9246-9e8c65de9bcb" released by "_delete_snapshot" :: held 1.813s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-7513dc56-9fab-4ccf-82a1-aca965d3ef74" released by "delete_snapshot" :: held 1.850s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:38 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1e37e6b-14e6-4067-b45a-4a2ea320a690" returned: 0 in 0.279s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] Created reservations ['6ca12b70-9623-4e9b-a609-5c4d5f9ad0e5', '9404c8ca-255a-41ab-a197-63856af88e02', '5a550b6e-ce78-449f-ae1d-ebd9c2036b33', '1d0d403e-cc66-44a0-833b-a44c620a8bb5'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Lock "cinder-quobyte-c1e37e6b-14e6-4067-b45a-4a2ea320a690" released by "delete_volume" :: held 0.744s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:38 devstack cinder-volume[87109]: WARNING cinder.quota [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:53:38 devstack cinder-volume[87109]: WARNING cinder.quota [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:53:38 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] Delete snapshot completed successfully. Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-e4c71366-bb96-4abb-b77e-4069b63ce592 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-312fbe6f-9f04-4704-9246-9e8c65de9bcb-delete_snapshot" released by "delete_snapshot" :: held 2.007s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Created reservations ['2772aa55-dc5c-4c96-842b-8f9dc456652f', '7c48d4f9-6c6c-490d-80ac-e946d57aa65b', '48e29743-5008-474b-8df5-b749688a436c', '72ded998-a033-4ae8-bf22-3d2e2f9d42b3'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:38 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:53:38 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:39 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-debad546-ffe8-4b96-9482-03da1cdb78ab tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-7513dc56-9fab-4ccf-82a1-aca965d3ef74-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:39 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-debad546-ffe8-4b96-9482-03da1cdb78ab tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-7513dc56-9fab-4ccf-82a1-aca965d3ef74-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:39 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-debad546-ffe8-4b96-9482-03da1cdb78ab tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-quobyte-7513dc56-9fab-4ccf-82a1-aca965d3ef74" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:39 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-debad546-ffe8-4b96-9482-03da1cdb78ab tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-7513dc56-9fab-4ccf-82a1-aca965d3ef74" acquired by "delete_volume" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:39 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.299s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:39 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:39 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Deleted volume successfully. Nov 05 03:53:39 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea059903-63f0-411c-9923-aebfe0ff266f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-debad546-ffe8-4b96-9482-03da1cdb78ab tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:39 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2685ef5e-9bb1-4af2-b431-4cc102eed95b tempest-VolumeAndVolumeTypeFromImageTest-209296692 None] Lock "cinder-c1e37e6b-14e6-4067-b45a-4a2ea320a690-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:39 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 Nov 05 03:53:39 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:39 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-debad546-ffe8-4b96-9482-03da1cdb78ab tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74" returned: 0 in 0.397s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-debad546-ffe8-4b96-9482-03da1cdb78ab tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:39 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74 Nov 05 03:53:39 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:39 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-debad546-ffe8-4b96-9482-03da1cdb78ab tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7513dc56-9fab-4ccf-82a1-aca965d3ef74" returned: 0 in 0.290s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:39 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-debad546-ffe8-4b96-9482-03da1cdb78ab tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-7513dc56-9fab-4ccf-82a1-aca965d3ef74" released by "delete_volume" :: held 0.771s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-debad546-ffe8-4b96-9482-03da1cdb78ab tempest-VolumesSnapshotTestJSON-1837012040 None] Created reservations ['95aadab2-fb5a-4fe1-8f11-a374b95ccd3a', '2092be2d-4160-43bd-95d0-5da35097ad58', 'a5dd5b6e-5826-47da-b216-0333ff8c1365', 'eeafcff0-6a07-4fd1-af7f-346befdd45d9'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Flow 'volume_create_manager' (5959044a-e0e6-4db4-ac63-a27544a9c6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfdb295-fcf7-4add-ac73-cdf6bc90a660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfdb295-fcf7-4add-ac73-cdf6bc90a660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1474775640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f05c2d-453d-4510-a942-3779ce0240b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6501ce66abff4283baa7262d222ff396',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=92c50241-2627-4e64-b165-6173e386636d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:40Z,use_quota=True,user_id='5b9d8dbdc1964480a02b097dd9b8bc3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a4376b-7e87-465a-a5a3-a787d15b13c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a4376b-7e87-465a-a5a3-a787d15b13c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c3c17d-6e12-468d-b55b-4f716b625225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c3c17d-6e12-468d-b55b-4f716b625225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b8f05c2d-453d-4510-a942-3779ce0240b9', 'volume_name': 'volume-b8f05c2d-453d-4510-a942-3779ce0240b9', 'volume_size': 1, 'snapshot_id': '92c50241-2627-4e64-b165-6173e386636d'}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2bf263-1140-4b38-89ad-5857a8b83977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2bf263-1140-4b38-89ad-5857a8b83977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ecfdac-a0a7-4c9f-adce-b56c4825cc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:40 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Volume b8f05c2d-453d-4510-a942-3779ce0240b9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b8f05c2d-453d-4510-a942-3779ce0240b9', 'volume_size': 1, 'snapshot_id': '92c50241-2627-4e64-b165-6173e386636d'} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "cinder-quobyte-92c50241-2627-4e64-b165-6173e386636d-b8f05c2d-453d-4510-a942-3779ce0240b9" by "_create_volume_from_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-debad546-ffe8-4b96-9482-03da1cdb78ab tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-debad546-ffe8-4b96-9482-03da1cdb78ab tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-debad546-ffe8-4b96-9482-03da1cdb78ab tempest-VolumesSnapshotTestJSON-1837012040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-debad546-ffe8-4b96-9482-03da1cdb78ab tempest-VolumesSnapshotTestJSON-1837012040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-debad546-ffe8-4b96-9482-03da1cdb78ab tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-debad546-ffe8-4b96-9482-03da1cdb78ab tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-92c50241-2627-4e64-b165-6173e386636d-b8f05c2d-453d-4510-a942-3779ce0240b9" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Creating volume b8f05c2d-453d-4510-a942-3779ce0240b9 from snapshot 92c50241-2627-4e64-b165-6173e386636d {{(pid=87109) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "cinder-quobyte-b8f05c2d-453d-4510-a942-3779ce0240b9" by "_copy_volume_from_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:40 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:53:40 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-b8f05c2d-453d-4510-a942-3779ce0240b9" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] snapshot: 92c50241-2627-4e64-b165-6173e386636d, volume: b8f05c2d-453d-4510-a942-3779ce0240b9, {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2a7f3a-6bc1-4858-a37e-3b6e59d0aeca]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:40 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d Nov 05 03:53:40 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:40 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-debad546-ffe8-4b96-9482-03da1cdb78ab tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.280s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-debad546-ffe8-4b96-9482-03da1cdb78ab tempest-VolumesSnapshotTestJSON-1837012040 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:40 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-debad546-ffe8-4b96-9482-03da1cdb78ab tempest-VolumesSnapshotTestJSON-1837012040 None] Deleted volume successfully. Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-debad546-ffe8-4b96-9482-03da1cdb78ab tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-7513dc56-9fab-4ccf-82a1-aca965d3ef74-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:40 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d" returned: 0 in 0.457s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0272038-b2a4-4994-bb10-8ee7f9798da3]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Flow 'volume_create_manager' (8881dcad-2ea3-413c-969b-d37c19925c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:40 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 Nov 05 03:53:40 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9901925d-217e-4672-861c-d84d94dab02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9901925d-217e-4672-861c-d84d94dab02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1592831090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94753541-67b1-44ab-ae12-577c514f3303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55dbe6fa0d045d586f8d0d676efcf2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:41Z,use_quota=True,user_id='813d6ffd490941ea8f194c177069bdd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb78b95d-b77f-47d7-b5fd-0431872fdfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb78b95d-b77f-47d7-b5fd-0431872fdfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f9f608-21a1-4bea-86db-5d13e74ca782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f9f608-21a1-4bea-86db-5d13e74ca782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94753541-67b1-44ab-ae12-577c514f3303', 'volume_name': 'volume-94753541-67b1-44ab-ae12-577c514f3303', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee3a6659-d8e2-4ba3-91a5-bf6f1196685f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee3a6659-d8e2-4ba3-91a5-bf6f1196685f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d102cde-aeaf-4cfa-bd28-ab3a51eec6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:41 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Volume 94753541-67b1-44ab-ae12-577c514f3303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94753541-67b1-44ab-ae12-577c514f3303', 'volume_size': 1} Nov 05 03:53:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:41 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91" returned: 0 in 0.430s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:41 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 03:53:41 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Creating direct copy from snapshot {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 03:53:41 devstack cinder-volume[87109]: DEBUG cinder.utils [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Path /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b8f05c2d-453d-4510-a942-3779ce0240b9 not found in is_blk_device check {{(pid=87109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 03:53:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b8f05c2d-453d-4510-a942-3779ce0240b9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:41 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b8f05c2d-453d-4510-a942-3779ce0240b9 Nov 05 03:53:41 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:46 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Flow 'volume_create_manager' (2df2f4f1-81a8-410b-a5bd-2765236225e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b37e5425-3c34-470b-ad62-627cc242ec4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b37e5425-3c34-470b-ad62-627cc242ec4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-363004514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02145b29-4935-4fd9-9fed-041a9a9cbfd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f487f173ef4749956c6633eadb589e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:46Z,use_quota=True,user_id='1d3e36287c934bcbb9a0a86b8fc8f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e77fb1e-378e-4815-81d5-63d1c8e8743c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e77fb1e-378e-4815-81d5-63d1c8e8743c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d485782-dfc3-4cb9-9ec1-c83ca7bf2cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d485782-dfc3-4cb9-9ec1-c83ca7bf2cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02145b29-4935-4fd9-9fed-041a9a9cbfd3', 'volume_name': 'volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92500fb4-aa66-4cd6-803e-00c308573414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92500fb4-aa66-4cd6-803e-00c308573414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b38faf-db6e-48bd-873f-0c605665b981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:46 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Volume 02145b29-4935-4fd9-9fed-041a9a9cbfd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3', 'volume_size': 1} Nov 05 03:53:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:47 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b8f05c2d-453d-4510-a942-3779ce0240b9" returned: 0 in 6.265s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:47 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Image conversion details: src /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91, size 1024.00 MB, duration 6.27 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b8f05c2d-453d-4510-a942-3779ce0240b9 {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:53:47 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Converted 1024.00 MB image at 163.44 MB/s Nov 05 03:53:47 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b8f05c2d-453d-4510-a942-3779ce0240b9 is being set with open permissions: ugo+rw Nov 05 03:53:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b8f05c2d-453d-4510-a942-3779ce0240b9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:47 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b8f05c2d-453d-4510-a942-3779ce0240b9 Nov 05 03:53:47 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:47 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b8f05c2d-453d-4510-a942-3779ce0240b9" returned: 0 in 0.233s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-b8f05c2d-453d-4510-a942-3779ce0240b9" released by "_copy_volume_from_snapshot" :: held 7.476s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-92c50241-2627-4e64-b165-6173e386636d-b8f05c2d-453d-4510-a942-3779ce0240b9" released by "_create_volume_from_snapshot" :: held 7.550s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.598s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.782s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1592831090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94753541-67b1-44ab-ae12-577c514f3303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55dbe6fa0d045d586f8d0d676efcf2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:41Z,use_quota=True,user_id='813d6ffd490941ea8f194c177069bdd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:53:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Creating volume 94753541-67b1-44ab-ae12-577c514f3303 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:53:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:53:47 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:53:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:47 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303 1073741824 Nov 05 03:53:47 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ecfdac-a0a7-4c9f-adce-b56c4825cc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8f05c2d-453d-4510-a942-3779ce0240b9', 'volume_size': 1, 'snapshot_id': '92c50241-2627-4e64-b165-6173e386636d'}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e35057-e177-41a5-92ea-c9d07a63a2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:47 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Volume volume-b8f05c2d-453d-4510-a942-3779ce0240b9 (b8f05c2d-453d-4510-a942-3779ce0240b9): created successfully Nov 05 03:53:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e35057-e177-41a5-92ea-c9d07a63a2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Flow 'volume_create_manager' (5959044a-e0e6-4db4-ac63-a27544a9c6b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:47 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-7ef9ee44-813f-47c4-9e6d-5fdc5c7cb259 tempest-VolumesDeleteCascade-157076980 None] Created volume successfully. Nov 05 03:53:48 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303 1073741824" returned: 0 in 0.413s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:48 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303 Nov 05 03:53:48 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:48 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303" returned: 0 in 0.254s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:53:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.270s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-363004514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02145b29-4935-4fd9-9fed-041a9a9cbfd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f487f173ef4749956c6633eadb589e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:46Z,use_quota=True,user_id='1d3e36287c934bcbb9a0a86b8fc8f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:53:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Creating volume 02145b29-4935-4fd9-9fed-041a9a9cbfd3 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:53:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:53:48 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:53:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:48 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3 1073741824 Nov 05 03:53:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d102cde-aeaf-4cfa-bd28-ab3a51eec6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94753541-67b1-44ab-ae12-577c514f3303', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:48 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6357f74-20b5-407b-b266-6b7c53d07283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:48 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Volume volume-94753541-67b1-44ab-ae12-577c514f3303 (94753541-67b1-44ab-ae12-577c514f3303): created successfully Nov 05 03:53:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6357f74-20b5-407b-b266-6b7c53d07283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Flow 'volume_create_manager' (8881dcad-2ea3-413c-969b-d37c19925c81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:48 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-aea93fca-358d-4141-9914-a21cf4e4526e tempest-VolumesSnapshotTestJSON-1837012040 None] Created volume successfully. Nov 05 03:53:48 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "cinder-d8db0967-3b7c-4a23-b0bf-e7a935043d91-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:48 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-d8db0967-3b7c-4a23-b0bf-e7a935043d91-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Performing cascade delete. {{(pid=87109) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1000}} Nov 05 03:53:49 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3 1073741824" returned: 0 in 0.489s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "cinder-92c50241-2627-4e64-b165-6173e386636d-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-92c50241-2627-4e64-b165-6173e386636d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "cinder-quobyte-d8db0967-3b7c-4a23-b0bf-e7a935043d91" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-d8db0967-3b7c-4a23-b0bf-e7a935043d91" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "cinder-quobyte-92c50241-2627-4e64-b165-6173e386636d" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:49 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3 Nov 05 03:53:49 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-92c50241-2627-4e64-b165-6173e386636d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Deleting offline snapshot 92c50241-2627-4e64-b165-6173e386636d of volume d8db0967-3b7c-4a23-b0bf-e7a935043d91 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] snapshot_file for this snap is: volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8e3757-d85c-49a1-b5a4-e20f615cf839]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:49 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d Nov 05 03:53:49 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:49 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3" returned: 0 in 0.263s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b38faf-db6e-48bd-873f-0c605665b981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086043a6-57ab-4aa3-b692-345e138cc24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:49 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Volume volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3 (02145b29-4935-4fd9-9fed-041a9a9cbfd3): created successfully Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086043a6-57ab-4aa3-b692-345e138cc24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Flow 'volume_create_manager' (2df2f4f1-81a8-410b-a5bd-2765236225e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:49 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-d82377f9-d307-477a-84ad-d41a70144840 tempest-CreateVolumesFromSnapshotTest-485460378 None] Created volume successfully. Nov 05 03:53:49 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d" returned: 0 in 0.363s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df9b9b9-ec0f-4dc9-b4ad-c431c8cd398d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:49 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 Nov 05 03:53:49 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-cab6b10f-66d9-4624-afb9-4aef0f30e6ae tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-cab6b10f-66d9-4624-afb9-4aef0f30e6ae tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-cab6b10f-66d9-4624-afb9-4aef0f30e6ae tempest-VolumesSnapshotTestJSON-1837012040 None] Creating offline snapshot 2f24499a-fd9b-44da-856a-adf73f67fdb4 of volume 94753541-67b1-44ab-ae12-577c514f3303 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e326b2fc-3f5e-40d1-b043-1089fe32be65]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cab6b10f-66d9-4624-afb9-4aef0f30e6ae tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:50 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303 Nov 05 03:53:50 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:50 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91" returned: 0 in 0.580s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:50 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d Nov 05 03:53:50 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:50 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cab6b10f-66d9-4624-afb9-4aef0f30e6ae tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303" returned: 0 in 0.421s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cab6b10f-66d9-4624-afb9-4aef0f30e6ae tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:50 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4 1G Nov 05 03:53:50 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7fb02c28-94d7-4665-afa0-94b9f3d4f29e tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:50 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d" returned: 0 in 0.421s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:50 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d Nov 05 03:53:50 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:50 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cab6b10f-66d9-4624-afb9-4aef0f30e6ae tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4 1G" returned: 0 in 0.412s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cab6b10f-66d9-4624-afb9-4aef0f30e6ae tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94753541-67b1-44ab-ae12-577c514f3303 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:50 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94753541-67b1-44ab-ae12-577c514f3303 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4 Nov 05 03:53:50 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:50 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91.92c50241-2627-4e64-b165-6173e386636d" returned: 0 in 0.267s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-92c50241-2627-4e64-b165-6173e386636d" released by "_delete_snapshot" :: held 1.746s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-d8db0967-3b7c-4a23-b0bf-e7a935043d91" released by "delete_snapshot" :: held 1.777s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:50 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Created reservations ['fa3ce7c1-985d-4b3f-a17c-fb5dcab28256', '2d8137eb-a0a4-4f1e-b9d8-64f0e2f5ca66', '9839032e-6043-4eba-8c7e-9ef953c92d7d', 'afcac5c7-bb9b-40af-933f-678629bf0ce9'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:51 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Delete snapshot completed successfully. Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-92c50241-2627-4e64-b165-6173e386636d-delete_snapshot" released by "delete_snapshot" :: held 1.965s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Snapshots deleted, issuing volume delete {{(pid=87109) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1015}} Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "cinder-quobyte-d8db0967-3b7c-4a23-b0bf-e7a935043d91" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-d8db0967-3b7c-4a23-b0bf-e7a935043d91" acquired by "delete_volume" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacf3fbb-6407-4742-b3be-3bd84fb2b611]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:51 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cab6b10f-66d9-4624-afb9-4aef0f30e6ae tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94753541-67b1-44ab-ae12-577c514f3303 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4" returned: 0 in 0.350s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:51 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-cab6b10f-66d9-4624-afb9-4aef0f30e6ae tempest-VolumesSnapshotTestJSON-1837012040 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4 is being set with open permissions: ugo+rw Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cab6b10f-66d9-4624-afb9-4aef0f30e6ae tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:51 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4 Nov 05 03:53:51 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:51 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 Nov 05 03:53:51 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:51 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cab6b10f-66d9-4624-afb9-4aef0f30e6ae tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4" returned: 0 in 0.269s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cab6b10f-66d9-4624-afb9-4aef0f30e6ae tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:51 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.info Nov 05 03:53:51 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:51 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91" returned: 0 in 0.405s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:51 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91 Nov 05 03:53:51 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:51 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cab6b10f-66d9-4624-afb9-4aef0f30e6ae tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.info" returned: 0 in 0.253s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:51 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-cab6b10f-66d9-4624-afb9-4aef0f30e6ae tempest-VolumesSnapshotTestJSON-1837012040 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.info is being set with open permissions: ugo+rw Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cab6b10f-66d9-4624-afb9-4aef0f30e6ae tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:51 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.info Nov 05 03:53:51 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:51 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d8db0967-3b7c-4a23-b0bf-e7a935043d91" returned: 0 in 0.272s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-d8db0967-3b7c-4a23-b0bf-e7a935043d91" released by "delete_volume" :: held 0.746s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Created reservations ['e4401778-76e7-4931-a69d-32bc9c6a81e5', '2db6effe-7425-40d7-83ed-4ba2b4d9f6c8', '13c3f80a-27aa-4fcc-9d4a-1d1a5fcb20d1', 'e4d4ec66-871f-4d3d-83ff-2d83e8698ffc'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:51 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:53:51 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:51 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cab6b10f-66d9-4624-afb9-4aef0f30e6ae tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.info" returned: 0 in 0.290s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-cab6b10f-66d9-4624-afb9-4aef0f30e6ae tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.099s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7fb02c28-94d7-4665-afa0-94b9f3d4f29e tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.472s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-7fb02c28-94d7-4665-afa0-94b9f3d4f29e tempest-CreateVolumesFromSnapshotTest-485460378 None] Creating offline snapshot af7f879a-1790-45db-8755-eceaa74e460c of volume 02145b29-4935-4fd9-9fed-041a9a9cbfd3 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:53:52 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-cab6b10f-66d9-4624-afb9-4aef0f30e6ae tempest-VolumesSnapshotTestJSON-1837012040 None] Create snapshot completed successfully Nov 05 03:53:52 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10aa4f5-23a6-4a81-9165-c950c1ef3e10]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7fb02c28-94d7-4665-afa0-94b9f3d4f29e tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:52 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.263s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:52 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:52 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Deleted volume successfully. Nov 05 03:53:52 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3 Nov 05 03:53:52 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b26241de-9db3-4536-87f0-530192beec15 tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-d8db0967-3b7c-4a23-b0bf-e7a935043d91-delete_volume" released by "delete_volume" :: held 3.285s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-581ad69a-4b72-4e07-8cde-319a5147b070 tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "cinder-b8f05c2d-453d-4510-a942-3779ce0240b9-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-581ad69a-4b72-4e07-8cde-319a5147b070 tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-b8f05c2d-453d-4510-a942-3779ce0240b9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-581ad69a-4b72-4e07-8cde-319a5147b070 tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "cinder-quobyte-b8f05c2d-453d-4510-a942-3779ce0240b9" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-581ad69a-4b72-4e07-8cde-319a5147b070 tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-b8f05c2d-453d-4510-a942-3779ce0240b9" acquired by "delete_volume" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:52 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[460f6347-c197-4eba-b8cf-85ce8dc166f7]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-581ad69a-4b72-4e07-8cde-319a5147b070 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b8f05c2d-453d-4510-a942-3779ce0240b9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:52 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7fb02c28-94d7-4665-afa0-94b9f3d4f29e tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3" returned: 0 in 0.419s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7fb02c28-94d7-4665-afa0-94b9f3d4f29e tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.af7f879a-1790-45db-8755-eceaa74e460c 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:52 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.af7f879a-1790-45db-8755-eceaa74e460c 1G Nov 05 03:53:52 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:52 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b8f05c2d-453d-4510-a942-3779ce0240b9 Nov 05 03:53:52 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:52 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-581ad69a-4b72-4e07-8cde-319a5147b070 tempest-VolumesDeleteCascade-157076980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b8f05c2d-453d-4510-a942-3779ce0240b9" returned: 0 in 0.381s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-581ad69a-4b72-4e07-8cde-319a5147b070 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b8f05c2d-453d-4510-a942-3779ce0240b9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:52 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b8f05c2d-453d-4510-a942-3779ce0240b9 Nov 05 03:53:52 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:52 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7fb02c28-94d7-4665-afa0-94b9f3d4f29e tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.af7f879a-1790-45db-8755-eceaa74e460c 1G" returned: 0 in 0.408s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7fb02c28-94d7-4665-afa0-94b9f3d4f29e tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.af7f879a-1790-45db-8755-eceaa74e460c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:52 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.af7f879a-1790-45db-8755-eceaa74e460c Nov 05 03:53:52 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:53 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-581ad69a-4b72-4e07-8cde-319a5147b070 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b8f05c2d-453d-4510-a942-3779ce0240b9" returned: 0 in 0.269s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-581ad69a-4b72-4e07-8cde-319a5147b070 tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-quobyte-b8f05c2d-453d-4510-a942-3779ce0240b9" released by "delete_volume" :: held 0.700s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-581ad69a-4b72-4e07-8cde-319a5147b070 tempest-VolumesDeleteCascade-157076980 None] Created reservations ['a5f5c970-f58b-4e66-8125-18091b97c0f9', 'ef0243f4-7461-43ba-8849-c89c8172ae78', '3e404f40-0d67-4191-94cf-03681dab3055', '5a5768a8-4743-44be-bcd3-5f4ef7df6891'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:53:53 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7fb02c28-94d7-4665-afa0-94b9f3d4f29e tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.af7f879a-1790-45db-8755-eceaa74e460c" returned: 0 in 0.310s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:53 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-7fb02c28-94d7-4665-afa0-94b9f3d4f29e tempest-CreateVolumesFromSnapshotTest-485460378 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.af7f879a-1790-45db-8755-eceaa74e460c is being set with open permissions: ugo+rw Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7fb02c28-94d7-4665-afa0-94b9f3d4f29e tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.af7f879a-1790-45db-8755-eceaa74e460c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:53 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.af7f879a-1790-45db-8755-eceaa74e460c Nov 05 03:53:53 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-581ad69a-4b72-4e07-8cde-319a5147b070 tempest-VolumesDeleteCascade-157076980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-581ad69a-4b72-4e07-8cde-319a5147b070 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-581ad69a-4b72-4e07-8cde-319a5147b070 tempest-VolumesDeleteCascade-157076980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-581ad69a-4b72-4e07-8cde-319a5147b070 tempest-VolumesDeleteCascade-157076980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-581ad69a-4b72-4e07-8cde-319a5147b070 tempest-VolumesDeleteCascade-157076980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-581ad69a-4b72-4e07-8cde-319a5147b070 tempest-VolumesDeleteCascade-157076980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:53 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:53:53 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:53 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7fb02c28-94d7-4665-afa0-94b9f3d4f29e tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.af7f879a-1790-45db-8755-eceaa74e460c" returned: 0 in 0.334s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7fb02c28-94d7-4665-afa0-94b9f3d4f29e tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:53 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.info Nov 05 03:53:53 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:53 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-581ad69a-4b72-4e07-8cde-319a5147b070 tempest-VolumesDeleteCascade-157076980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.333s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-581ad69a-4b72-4e07-8cde-319a5147b070 tempest-VolumesDeleteCascade-157076980 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:53 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-581ad69a-4b72-4e07-8cde-319a5147b070 tempest-VolumesDeleteCascade-157076980 None] Deleted volume successfully. Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-581ad69a-4b72-4e07-8cde-319a5147b070 tempest-VolumesDeleteCascade-157076980 None] Lock "cinder-b8f05c2d-453d-4510-a942-3779ce0240b9-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Flow 'volume_create_manager' (f68ce8e8-5b14-40c0-a2f4-cf7e5fd325a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4853b5e-0e4a-49d0-b4ec-886f68ca2296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4853b5e-0e4a-49d0-b4ec-886f68ca2296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-562586988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba6a8c2-64d4-498d-9450-a980bc552c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55dbe6fa0d045d586f8d0d676efcf2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2f24499a-fd9b-44da-856a-adf73f67fdb4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:54Z,use_quota=True,user_id='813d6ffd490941ea8f194c177069bdd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e763d973-40bb-4407-9206-9a2bb2658851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e763d973-40bb-4407-9206-9a2bb2658851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09731f79-37f1-4348-ae2c-47aa6691f161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09731f79-37f1-4348-ae2c-47aa6691f161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eba6a8c2-64d4-498d-9450-a980bc552c79', 'volume_name': 'volume-eba6a8c2-64d4-498d-9450-a980bc552c79', 'volume_size': 1, 'snapshot_id': '2f24499a-fd9b-44da-856a-adf73f67fdb4'}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38a8bb8-0349-4eb0-9e92-3f11ab86e5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38a8bb8-0349-4eb0-9e92-3f11ab86e5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab72a2b1-5531-4317-9917-25add7105b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:53 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Volume eba6a8c2-64d4-498d-9450-a980bc552c79: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eba6a8c2-64d4-498d-9450-a980bc552c79', 'volume_size': 1, 'snapshot_id': '2f24499a-fd9b-44da-856a-adf73f67fdb4'} Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:53 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7fb02c28-94d7-4665-afa0-94b9f3d4f29e tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.info" returned: 0 in 0.306s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:53 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-7fb02c28-94d7-4665-afa0-94b9f3d4f29e tempest-CreateVolumesFromSnapshotTest-485460378 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.info is being set with open permissions: ugo+rw Nov 05 03:53:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7fb02c28-94d7-4665-afa0-94b9f3d4f29e tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:53 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.info Nov 05 03:53:53 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:54 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7fb02c28-94d7-4665-afa0-94b9f3d4f29e tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.info" returned: 0 in 0.250s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7fb02c28-94d7-4665-afa0-94b9f3d4f29e tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.157s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.291s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-quobyte-2f24499a-fd9b-44da-856a-adf73f67fdb4-eba6a8c2-64d4-498d-9450-a980bc552c79" by "_create_volume_from_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-2f24499a-fd9b-44da-856a-adf73f67fdb4-eba6a8c2-64d4-498d-9450-a980bc552c79" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Creating volume eba6a8c2-64d4-498d-9450-a980bc552c79 from snapshot 2f24499a-fd9b-44da-856a-adf73f67fdb4 {{(pid=87109) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-quobyte-eba6a8c2-64d4-498d-9450-a980bc552c79" by "_copy_volume_from_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:53:54 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-7fb02c28-94d7-4665-afa0-94b9f3d4f29e tempest-CreateVolumesFromSnapshotTest-485460378 None] Create snapshot completed successfully Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-eba6a8c2-64d4-498d-9450-a980bc552c79" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] snapshot: 2f24499a-fd9b-44da-856a-adf73f67fdb4, volume: eba6a8c2-64d4-498d-9450-a980bc552c79, {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0064fa65-079b-42b7-b0ff-cf58ae667493]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:54 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4 Nov 05 03:53:54 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:54 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4" returned: 0 in 0.411s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94753541-67b1-44ab-ae12-577c514f3303(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fac91bf-1e2b-4cf4-97ca-6b7f0f5bba02]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:53:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:54 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303 Nov 05 03:53:54 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:55 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303" returned: 0 in 0.500s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303 {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 03:53:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Creating direct copy from snapshot {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 03:53:55 devstack cinder-volume[87109]: DEBUG cinder.utils [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Path /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eba6a8c2-64d4-498d-9450-a980bc552c79 not found in is_blk_device check {{(pid=87109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 03:53:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eba6a8c2-64d4-498d-9450-a980bc552c79 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:55 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eba6a8c2-64d4-498d-9450-a980bc552c79 Nov 05 03:53:55 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:55 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Flow 'volume_create_manager' (1c60bfa9-f576-435c-ae4e-2c8ed47eba59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e676ef29-ccbb-408d-9e0d-ffe38f33c001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e676ef29-ccbb-408d-9e0d-ffe38f33c001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-463800188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cdf7674-6752-495e-b37b-f3fe13b46454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f487f173ef4749956c6633eadb589e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:55Z,use_quota=True,user_id='1d3e36287c934bcbb9a0a86b8fc8f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bf287e-c5cf-4abc-8e9e-8142fb769359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bf287e-c5cf-4abc-8e9e-8142fb769359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e800fd9a-032e-4757-bf59-3297dba20ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e800fd9a-032e-4757-bf59-3297dba20ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cdf7674-6752-495e-b37b-f3fe13b46454', 'volume_name': 'volume-6cdf7674-6752-495e-b37b-f3fe13b46454', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e79bd4-4df1-4945-9e11-155eece90a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e79bd4-4df1-4945-9e11-155eece90a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8878b5a7-606a-4742-8e6e-e4771c4a0119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:55 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Volume 6cdf7674-6752-495e-b37b-f3fe13b46454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cdf7674-6752-495e-b37b-f3fe13b46454', 'volume_size': 1} Nov 05 03:53:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:55 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Flow 'volume_create_manager' (6645a1e9-abce-42a2-9bea-c4be5df24751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b977930-0699-4339-8d61-8a1acb17110d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b977930-0699-4339-8d61-8a1acb17110d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2050625182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a379d5b-0f33-4326-b20c-f996ff708f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f487f173ef4749956c6633eadb589e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:56Z,use_quota=True,user_id='1d3e36287c934bcbb9a0a86b8fc8f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf0ad3a-bdea-4bea-a837-65c2b1d3c8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf0ad3a-bdea-4bea-a837-65c2b1d3c8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a9e5f9-a4b9-4727-a574-3677878e826c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a9e5f9-a4b9-4727-a574-3677878e826c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a379d5b-0f33-4326-b20c-f996ff708f74', 'volume_name': 'volume-6a379d5b-0f33-4326-b20c-f996ff708f74', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b07ae32-6207-4cef-b504-40a7e7539747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b07ae32-6207-4cef-b504-40a7e7539747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00961601-5951-4694-9eb4-48c8f172e9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:56 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Volume 6a379d5b-0f33-4326-b20c-f996ff708f74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a379d5b-0f33-4326-b20c-f996ff708f74', 'volume_size': 1} Nov 05 03:53:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:56 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Flow 'volume_create_manager' (d8178783-969b-4280-a2a3-9ff743745f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4547cf3-14df-4767-a8d9-cbc3a73422a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4547cf3-14df-4767-a8d9-cbc3a73422a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-359279177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22df2b0c-2e14-41b0-ae6e-727f702fdfdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f487f173ef4749956c6633eadb589e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:56Z,use_quota=True,user_id='1d3e36287c934bcbb9a0a86b8fc8f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002610d4-01be-40cc-af48-0cd6a9f12230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002610d4-01be-40cc-af48-0cd6a9f12230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2effd124-e7f6-46ac-9648-6b1ebfdeb50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2effd124-e7f6-46ac-9648-6b1ebfdeb50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22df2b0c-2e14-41b0-ae6e-727f702fdfdf', 'volume_name': 'volume-22df2b0c-2e14-41b0-ae6e-727f702fdfdf', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c39ef7-e21b-4e88-8d89-080fc06cc98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c39ef7-e21b-4e88-8d89-080fc06cc98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215264ed-e899-427b-9a0d-aa32a61729da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:56 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Volume 22df2b0c-2e14-41b0-ae6e-727f702fdfdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22df2b0c-2e14-41b0-ae6e-727f702fdfdf', 'volume_size': 1} Nov 05 03:53:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:57 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Flow 'volume_create_manager' (f5e2b891-c4d7-43bd-9362-c2cc7c0258c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f6a83f-60f5-4fd1-82a9-0665762752b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19f6a83f-60f5-4fd1-82a9-0665762752b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-829052620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b04144-ed6f-475b-92c7-3a7ba1c22bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f487f173ef4749956c6633eadb589e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:57Z,use_quota=True,user_id='1d3e36287c934bcbb9a0a86b8fc8f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d8fc8d-f7ad-47fc-a6ff-bcfaab20ac6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d8fc8d-f7ad-47fc-a6ff-bcfaab20ac6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40571e94-3ce0-4cc9-82ae-7dcf902a7da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40571e94-3ce0-4cc9-82ae-7dcf902a7da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60b04144-ed6f-475b-92c7-3a7ba1c22bf0', 'volume_name': 'volume-60b04144-ed6f-475b-92c7-3a7ba1c22bf0', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e2d22b-6ef3-42be-923c-88542ce48c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e2d22b-6ef3-42be-923c-88542ce48c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd701466-8d82-481a-b4e8-f2cf15aa1e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:57 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Volume 60b04144-ed6f-475b-92c7-3a7ba1c22bf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60b04144-ed6f-475b-92c7-3a7ba1c22bf0', 'volume_size': 1} Nov 05 03:53:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Flow 'volume_create_manager' (fe33f891-1a60-43a9-aa76-a9419d84037b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95aea415-29e1-4293-94b6-896f65acf6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95aea415-29e1-4293-94b6-896f65acf6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1597178495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a271e4-99b4-494f-bca5-b5be199555e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f487f173ef4749956c6633eadb589e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:58Z,use_quota=True,user_id='1d3e36287c934bcbb9a0a86b8fc8f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0e8003-2e6a-4a6a-87fa-be7a4439f165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0e8003-2e6a-4a6a-87fa-be7a4439f165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be94a139-9c7a-4049-9289-cef75dc56001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be94a139-9c7a-4049-9289-cef75dc56001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a271e4-99b4-494f-bca5-b5be199555e6', 'volume_name': 'volume-82a271e4-99b4-494f-bca5-b5be199555e6', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d4737a-7ad0-4296-bd91-ffc1b88cc35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d4737a-7ad0-4296-bd91-ffc1b88cc35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f75f8d9-ecd2-45f5-b4d7-ca7479906b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:53:58 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Volume 82a271e4-99b4-494f-bca5-b5be199555e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a271e4-99b4-494f-bca5-b5be199555e6', 'volume_size': 1} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:53:58 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:53:58 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:53:58 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.406s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 28 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:53:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:54:02 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eba6a8c2-64d4-498d-9450-a980bc552c79" returned: 0 in 7.587s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:02 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Image conversion details: src /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303, size 1024.00 MB, duration 7.59 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eba6a8c2-64d4-498d-9450-a980bc552c79 {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:54:02 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Converted 1024.00 MB image at 134.94 MB/s Nov 05 03:54:02 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eba6a8c2-64d4-498d-9450-a980bc552c79 is being set with open permissions: ugo+rw Nov 05 03:54:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eba6a8c2-64d4-498d-9450-a980bc552c79 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:02 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eba6a8c2-64d4-498d-9450-a980bc552c79 Nov 05 03:54:02 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:03 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eba6a8c2-64d4-498d-9450-a980bc552c79" returned: 0 in 0.239s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-eba6a8c2-64d4-498d-9450-a980bc552c79" released by "_copy_volume_from_snapshot" :: held 8.832s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-2f24499a-fd9b-44da-856a-adf73f67fdb4-eba6a8c2-64d4-498d-9450-a980bc552c79" released by "_create_volume_from_snapshot" :: held 8.910s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.937s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.614s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-463800188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cdf7674-6752-495e-b37b-f3fe13b46454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f487f173ef4749956c6633eadb589e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:55Z,use_quota=True,user_id='1d3e36287c934bcbb9a0a86b8fc8f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Creating volume 6cdf7674-6752-495e-b37b-f3fe13b46454 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:54:03 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6cdf7674-6752-495e-b37b-f3fe13b46454 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:03 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6cdf7674-6752-495e-b37b-f3fe13b46454 1073741824 Nov 05 03:54:03 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab72a2b1-5531-4317-9917-25add7105b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eba6a8c2-64d4-498d-9450-a980bc552c79', 'volume_size': 1, 'snapshot_id': '2f24499a-fd9b-44da-856a-adf73f67fdb4'}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17e714b-57d8-41f1-8e8a-774abb8c0d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:03 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Volume volume-eba6a8c2-64d4-498d-9450-a980bc552c79 (eba6a8c2-64d4-498d-9450-a980bc552c79): created successfully Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17e714b-57d8-41f1-8e8a-774abb8c0d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Flow 'volume_create_manager' (f68ce8e8-5b14-40c0-a2f4-cf7e5fd325a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:03 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-35955fc5-bcec-4f46-9eef-5cc23672df70 tempest-VolumesSnapshotTestJSON-1837012040 None] Created volume successfully. Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5a406f94-ce8c-43cf-bae8-de0581fd19b5 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-eba6a8c2-64d4-498d-9450-a980bc552c79-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5a406f94-ce8c-43cf-bae8-de0581fd19b5 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-eba6a8c2-64d4-498d-9450-a980bc552c79-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5a406f94-ce8c-43cf-bae8-de0581fd19b5 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-quobyte-eba6a8c2-64d4-498d-9450-a980bc552c79" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:03 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6cdf7674-6752-495e-b37b-f3fe13b46454 1073741824" returned: 0 in 0.588s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5a406f94-ce8c-43cf-bae8-de0581fd19b5 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-eba6a8c2-64d4-498d-9450-a980bc552c79" acquired by "delete_volume" :: waited 0.020s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[be92981a-4798-4d9a-acf8-93838c4b726b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5a406f94-ce8c-43cf-bae8-de0581fd19b5 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eba6a8c2-64d4-498d-9450-a980bc552c79 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6cdf7674-6752-495e-b37b-f3fe13b46454 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:03 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6cdf7674-6752-495e-b37b-f3fe13b46454 Nov 05 03:54:03 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:03 devstack sudo[100868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eba6a8c2-64d4-498d-9450-a980bc552c79 Nov 05 03:54:03 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:04 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6cdf7674-6752-495e-b37b-f3fe13b46454" returned: 0 in 0.258s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.937s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2050625182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a379d5b-0f33-4326-b20c-f996ff708f74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f487f173ef4749956c6633eadb589e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:56Z,use_quota=True,user_id='1d3e36287c934bcbb9a0a86b8fc8f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Creating volume 6a379d5b-0f33-4326-b20c-f996ff708f74 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:54:04 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a379d5b-0f33-4326-b20c-f996ff708f74 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8878b5a7-606a-4742-8e6e-e4771c4a0119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cdf7674-6752-495e-b37b-f3fe13b46454', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:04 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a379d5b-0f33-4326-b20c-f996ff708f74 1073741824 Nov 05 03:54:04 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ed5acd-8a85-4670-90b8-62031225a6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:04 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Volume volume-6cdf7674-6752-495e-b37b-f3fe13b46454 (6cdf7674-6752-495e-b37b-f3fe13b46454): created successfully Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ed5acd-8a85-4670-90b8-62031225a6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Flow 'volume_create_manager' (1c60bfa9-f576-435c-ae4e-2c8ed47eba59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:04 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-a0802408-83fe-4a0e-af28-51c2f3e8274c tempest-CreateVolumesFromSnapshotTest-485460378 None] Created volume successfully. Nov 05 03:54:04 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5a406f94-ce8c-43cf-bae8-de0581fd19b5 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eba6a8c2-64d4-498d-9450-a980bc552c79" returned: 0 in 0.444s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5a406f94-ce8c-43cf-bae8-de0581fd19b5 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eba6a8c2-64d4-498d-9450-a980bc552c79 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:04 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eba6a8c2-64d4-498d-9450-a980bc552c79 Nov 05 03:54:04 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:04 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5a406f94-ce8c-43cf-bae8-de0581fd19b5 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eba6a8c2-64d4-498d-9450-a980bc552c79" returned: 0 in 0.317s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5a406f94-ce8c-43cf-bae8-de0581fd19b5 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-eba6a8c2-64d4-498d-9450-a980bc552c79" released by "delete_volume" :: held 0.818s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-5a406f94-ce8c-43cf-bae8-de0581fd19b5 tempest-VolumesSnapshotTestJSON-1837012040 None] Created reservations ['8e776475-c73f-41ea-b991-260ff5c27bdd', 'db30c4dd-0b23-4c5f-8744-18dae32115c5', '0e6d7374-480e-4e19-b83c-e9da2ba7f78a', '76bbf744-99c5-4b99-8837-28c2bc2d9584'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:04 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a379d5b-0f33-4326-b20c-f996ff708f74 1073741824" returned: 0 in 0.696s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a379d5b-0f33-4326-b20c-f996ff708f74 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5a406f94-ce8c-43cf-bae8-de0581fd19b5 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5a406f94-ce8c-43cf-bae8-de0581fd19b5 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5a406f94-ce8c-43cf-bae8-de0581fd19b5 tempest-VolumesSnapshotTestJSON-1837012040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5a406f94-ce8c-43cf-bae8-de0581fd19b5 tempest-VolumesSnapshotTestJSON-1837012040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5a406f94-ce8c-43cf-bae8-de0581fd19b5 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5a406f94-ce8c-43cf-bae8-de0581fd19b5 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:04 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a379d5b-0f33-4326-b20c-f996ff708f74 Nov 05 03:54:04 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:04 devstack sudo[100887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:54:04 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:05 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a379d5b-0f33-4326-b20c-f996ff708f74" returned: 0 in 0.307s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.290s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-359279177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22df2b0c-2e14-41b0-ae6e-727f702fdfdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f487f173ef4749956c6633eadb589e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:56Z,use_quota=True,user_id='1d3e36287c934bcbb9a0a86b8fc8f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Creating volume 22df2b0c-2e14-41b0-ae6e-727f702fdfdf {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:54:05 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-22df2b0c-2e14-41b0-ae6e-727f702fdfdf 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:05 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5a406f94-ce8c-43cf-bae8-de0581fd19b5 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.312s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-5a406f94-ce8c-43cf-bae8-de0581fd19b5 tempest-VolumesSnapshotTestJSON-1837012040 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:54:05 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-22df2b0c-2e14-41b0-ae6e-727f702fdfdf 1073741824 Nov 05 03:54:05 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00961601-5951-4694-9eb4-48c8f172e9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a379d5b-0f33-4326-b20c-f996ff708f74', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6539a9-5726-40ca-aeeb-e5132c069486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:05 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5a406f94-ce8c-43cf-bae8-de0581fd19b5 tempest-VolumesSnapshotTestJSON-1837012040 None] Deleted volume successfully. Nov 05 03:54:05 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Volume volume-6a379d5b-0f33-4326-b20c-f996ff708f74 (6a379d5b-0f33-4326-b20c-f996ff708f74): created successfully Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6539a9-5726-40ca-aeeb-e5132c069486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Flow 'volume_create_manager' (6645a1e9-abce-42a2-9bea-c4be5df24751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5a406f94-ce8c-43cf-bae8-de0581fd19b5 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-eba6a8c2-64d4-498d-9450-a980bc552c79-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:05 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-4d3ee4b5-cf00-4334-baba-74465b21a9d8 tempest-CreateVolumesFromSnapshotTest-485460378 None] Created volume successfully. Nov 05 03:54:05 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-22df2b0c-2e14-41b0-ae6e-727f702fdfdf 1073741824" returned: 0 in 0.471s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-22df2b0c-2e14-41b0-ae6e-727f702fdfdf {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:05 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-22df2b0c-2e14-41b0-ae6e-727f702fdfdf Nov 05 03:54:05 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:05 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-22df2b0c-2e14-41b0-ae6e-727f702fdfdf" returned: 0 in 0.294s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.303s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-829052620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b04144-ed6f-475b-92c7-3a7ba1c22bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f487f173ef4749956c6633eadb589e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:57Z,use_quota=True,user_id='1d3e36287c934bcbb9a0a86b8fc8f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Creating volume 60b04144-ed6f-475b-92c7-3a7ba1c22bf0 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:54:06 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-60b04144-ed6f-475b-92c7-3a7ba1c22bf0 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-2f24499a-fd9b-44da-856a-adf73f67fdb4-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:06 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-60b04144-ed6f-475b-92c7-3a7ba1c22bf0 1073741824 Nov 05 03:54:06 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215264ed-e899-427b-9a0d-aa32a61729da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22df2b0c-2e14-41b0-ae6e-727f702fdfdf', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9f67cf-b36c-4ef5-86a5-e05f80466d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-2f24499a-fd9b-44da-856a-adf73f67fdb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-quobyte-94753541-67b1-44ab-ae12-577c514f3303" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:06 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Volume volume-22df2b0c-2e14-41b0-ae6e-727f702fdfdf (22df2b0c-2e14-41b0-ae6e-727f702fdfdf): created successfully Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9f67cf-b36c-4ef5-86a5-e05f80466d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Flow 'volume_create_manager' (d8178783-969b-4280-a2a3-9ff743745f23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:06 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-1ca17546-7fc1-4343-90b5-7bf5ca55f541 tempest-CreateVolumesFromSnapshotTest-485460378 None] Created volume successfully. Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-94753541-67b1-44ab-ae12-577c514f3303" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-quobyte-2f24499a-fd9b-44da-856a-adf73f67fdb4" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-2f24499a-fd9b-44da-856a-adf73f67fdb4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] Deleting offline snapshot 2f24499a-fd9b-44da-856a-adf73f67fdb4 of volume 94753541-67b1-44ab-ae12-577c514f3303 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] snapshot_file for this snap is: volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b8746b-cb20-47ef-9ec6-a933247d2304]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:06 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4 Nov 05 03:54:06 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:06 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-60b04144-ed6f-475b-92c7-3a7ba1c22bf0 1073741824" returned: 0 in 0.545s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-60b04144-ed6f-475b-92c7-3a7ba1c22bf0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:06 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4" returned: 0 in 0.426s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94753541-67b1-44ab-ae12-577c514f3303(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:54:06 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-60b04144-ed6f-475b-92c7-3a7ba1c22bf0 Nov 05 03:54:06 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[88aef986-6097-4ac2-a06f-dfc148a779fe]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:06 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303 Nov 05 03:54:06 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:06 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-60b04144-ed6f-475b-92c7-3a7ba1c22bf0" returned: 0 in 0.261s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.356s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1597178495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a271e4-99b4-494f-bca5-b5be199555e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f487f173ef4749956c6633eadb589e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:53:58Z,use_quota=True,user_id='1d3e36287c934bcbb9a0a86b8fc8f8ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Creating volume 82a271e4-99b4-494f-bca5-b5be199555e6 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:54:06 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-82a271e4-99b4-494f-bca5-b5be199555e6 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd701466-8d82-481a-b4e8-f2cf15aa1e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60b04144-ed6f-475b-92c7-3a7ba1c22bf0', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55bb0b5a-da95-4bdc-a503-7a61a998e253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:06 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-82a271e4-99b4-494f-bca5-b5be199555e6 1073741824 Nov 05 03:54:06 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:06 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Volume volume-60b04144-ed6f-475b-92c7-3a7ba1c22bf0 (60b04144-ed6f-475b-92c7-3a7ba1c22bf0): created successfully Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55bb0b5a-da95-4bdc-a503-7a61a998e253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Flow 'volume_create_manager' (f5e2b891-c4d7-43bd-9362-c2cc7c0258c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:06 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-6c1b3ae3-d340-4c52-b281-dec3d5f0efe6 tempest-CreateVolumesFromSnapshotTest-485460378 None] Created volume successfully. Nov 05 03:54:07 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303" returned: 0 in 0.652s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:07 devstack sudo[100929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4 Nov 05 03:54:07 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:07 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-82a271e4-99b4-494f-bca5-b5be199555e6 1073741824" returned: 0 in 0.669s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-82a271e4-99b4-494f-bca5-b5be199555e6 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:07 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-82a271e4-99b4-494f-bca5-b5be199555e6 Nov 05 03:54:07 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:07 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4" returned: 0 in 0.483s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:07 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4 Nov 05 03:54:07 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:07 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-82a271e4-99b4-494f-bca5-b5be199555e6" returned: 0 in 0.295s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:07 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:54:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f75f8d9-ecd2-45f5-b4d7-ca7479906b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a271e4-99b4-494f-bca5-b5be199555e6', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bebebcda-5321-4eaf-9059-7a2b78d61d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:07 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Volume volume-82a271e4-99b4-494f-bca5-b5be199555e6 (82a271e4-99b4-494f-bca5-b5be199555e6): created successfully Nov 05 03:54:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bebebcda-5321-4eaf-9059-7a2b78d61d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Flow 'volume_create_manager' (fe33f891-1a60-43a9-aa76-a9419d84037b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:07 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-02303cb2-a142-414c-9559-522112bdbcff tempest-CreateVolumesFromSnapshotTest-485460378 None] Created volume successfully. Nov 05 03:54:08 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303.2f24499a-fd9b-44da-856a-adf73f67fdb4" returned: 0 in 0.278s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-2f24499a-fd9b-44da-856a-adf73f67fdb4" released by "_delete_snapshot" :: held 1.989s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-94753541-67b1-44ab-ae12-577c514f3303" released by "delete_snapshot" :: held 2.014s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:08 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] Created reservations ['59765290-c616-43e9-908c-184e06e80959', '5869b5a7-bb38-4d68-ba65-19695fdee8e5', '1c0b24ec-7ee1-4859-9d75-d2154a15fadf', '8d2f0e78-5555-4c2c-bf5a-24e5f475b719'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:08 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] Delete snapshot completed successfully. Nov 05 03:54:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5bf9b4bb-abf1-49d3-a58d-be43c3b19542 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-2f24499a-fd9b-44da-856a-adf73f67fdb4-delete_snapshot" released by "delete_snapshot" :: held 2.185s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-65a7eb18-38b2-4165-845b-791f9b57c9c7 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "cinder-82a271e4-99b4-494f-bca5-b5be199555e6-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-65a7eb18-38b2-4165-845b-791f9b57c9c7 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-82a271e4-99b4-494f-bca5-b5be199555e6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-65a7eb18-38b2-4165-845b-791f9b57c9c7 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "cinder-quobyte-82a271e4-99b4-494f-bca5-b5be199555e6" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-65a7eb18-38b2-4165-845b-791f9b57c9c7 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-quobyte-82a271e4-99b4-494f-bca5-b5be199555e6" acquired by "delete_volume" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:08 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6336fb-9522-450f-85e0-c76c0e34afad]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-65a7eb18-38b2-4165-845b-791f9b57c9c7 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-82a271e4-99b4-494f-bca5-b5be199555e6 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:08 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-82a271e4-99b4-494f-bca5-b5be199555e6 Nov 05 03:54:08 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:08 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-65a7eb18-38b2-4165-845b-791f9b57c9c7 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-82a271e4-99b4-494f-bca5-b5be199555e6" returned: 0 in 0.369s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-65a7eb18-38b2-4165-845b-791f9b57c9c7 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-82a271e4-99b4-494f-bca5-b5be199555e6 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:08 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-82a271e4-99b4-494f-bca5-b5be199555e6 Nov 05 03:54:08 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:09 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-65a7eb18-38b2-4165-845b-791f9b57c9c7 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-82a271e4-99b4-494f-bca5-b5be199555e6" returned: 0 in 0.279s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-65a7eb18-38b2-4165-845b-791f9b57c9c7 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-quobyte-82a271e4-99b4-494f-bca5-b5be199555e6" released by "delete_volume" :: held 0.698s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-65a7eb18-38b2-4165-845b-791f9b57c9c7 tempest-CreateVolumesFromSnapshotTest-485460378 None] Created reservations ['be7f501f-c317-4dc3-854e-02ba77d65eea', '6b6d72e0-86ac-465f-a842-b8348872c02f', 'fc787dbb-4952-4b70-b68c-6d73eca4506f', 'ea398f61-b51a-4fdf-b882-7d3924d0da1f'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-957276fd-02b2-4788-8de4-e2a7dac0c3a5 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-94753541-67b1-44ab-ae12-577c514f3303-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-957276fd-02b2-4788-8de4-e2a7dac0c3a5 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-94753541-67b1-44ab-ae12-577c514f3303-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-65a7eb18-38b2-4165-845b-791f9b57c9c7 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-65a7eb18-38b2-4165-845b-791f9b57c9c7 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-65a7eb18-38b2-4165-845b-791f9b57c9c7 tempest-CreateVolumesFromSnapshotTest-485460378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-65a7eb18-38b2-4165-845b-791f9b57c9c7 tempest-CreateVolumesFromSnapshotTest-485460378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-65a7eb18-38b2-4165-845b-791f9b57c9c7 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-65a7eb18-38b2-4165-845b-791f9b57c9c7 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:09 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:54:09 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-957276fd-02b2-4788-8de4-e2a7dac0c3a5 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-quobyte-94753541-67b1-44ab-ae12-577c514f3303" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-957276fd-02b2-4788-8de4-e2a7dac0c3a5 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-94753541-67b1-44ab-ae12-577c514f3303" acquired by "delete_volume" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[4857f2df-2127-4714-949b-9abe14b63173]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-957276fd-02b2-4788-8de4-e2a7dac0c3a5 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5d010c25-0836-44b0-8863-9cd060b0447b tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "cinder-60b04144-ed6f-475b-92c7-3a7ba1c22bf0-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5d010c25-0836-44b0-8863-9cd060b0447b tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-60b04144-ed6f-475b-92c7-3a7ba1c22bf0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5d010c25-0836-44b0-8863-9cd060b0447b tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "cinder-quobyte-60b04144-ed6f-475b-92c7-3a7ba1c22bf0" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5d010c25-0836-44b0-8863-9cd060b0447b tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-quobyte-60b04144-ed6f-475b-92c7-3a7ba1c22bf0" acquired by "delete_volume" :: waited 0.020s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:09 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303 Nov 05 03:54:09 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:09 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-65a7eb18-38b2-4165-845b-791f9b57c9c7 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.407s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-65a7eb18-38b2-4165-845b-791f9b57c9c7 tempest-CreateVolumesFromSnapshotTest-485460378 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:54:09 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-65a7eb18-38b2-4165-845b-791f9b57c9c7 tempest-CreateVolumesFromSnapshotTest-485460378 None] Deleted volume successfully. Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb1498c-9f7b-45df-99c9-a407e40c93d9]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5d010c25-0836-44b0-8863-9cd060b0447b tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-60b04144-ed6f-475b-92c7-3a7ba1c22bf0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-65a7eb18-38b2-4165-845b-791f9b57c9c7 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-82a271e4-99b4-494f-bca5-b5be199555e6-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:10 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-60b04144-ed6f-475b-92c7-3a7ba1c22bf0 Nov 05 03:54:10 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:10 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-957276fd-02b2-4788-8de4-e2a7dac0c3a5 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303" returned: 0 in 0.542s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-957276fd-02b2-4788-8de4-e2a7dac0c3a5 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:10 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303 Nov 05 03:54:10 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:10 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5d010c25-0836-44b0-8863-9cd060b0447b tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-60b04144-ed6f-475b-92c7-3a7ba1c22bf0" returned: 0 in 0.481s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5d010c25-0836-44b0-8863-9cd060b0447b tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-60b04144-ed6f-475b-92c7-3a7ba1c22bf0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:10 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-60b04144-ed6f-475b-92c7-3a7ba1c22bf0 Nov 05 03:54:10 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:10 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-957276fd-02b2-4788-8de4-e2a7dac0c3a5 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-94753541-67b1-44ab-ae12-577c514f3303" returned: 0 in 0.321s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-957276fd-02b2-4788-8de4-e2a7dac0c3a5 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-94753541-67b1-44ab-ae12-577c514f3303" released by "delete_volume" :: held 0.997s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:10 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-957276fd-02b2-4788-8de4-e2a7dac0c3a5 tempest-VolumesSnapshotTestJSON-1837012040 None] Created reservations ['bb9bf3a1-7399-4113-9046-4372caed94fe', '58b16ec9-af55-4439-a580-9ed91bd76560', '03aa0dba-2ad8-4a66-bf74-54dfe2ea5592', 'e94c7e23-e597-4996-ab8e-b5eba37e462b'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:10 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5d010c25-0836-44b0-8863-9cd060b0447b tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-60b04144-ed6f-475b-92c7-3a7ba1c22bf0" returned: 0 in 0.351s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5d010c25-0836-44b0-8863-9cd060b0447b tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-quobyte-60b04144-ed6f-475b-92c7-3a7ba1c22bf0" released by "delete_volume" :: held 0.904s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-957276fd-02b2-4788-8de4-e2a7dac0c3a5 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-957276fd-02b2-4788-8de4-e2a7dac0c3a5 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-957276fd-02b2-4788-8de4-e2a7dac0c3a5 tempest-VolumesSnapshotTestJSON-1837012040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-957276fd-02b2-4788-8de4-e2a7dac0c3a5 tempest-VolumesSnapshotTestJSON-1837012040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-957276fd-02b2-4788-8de4-e2a7dac0c3a5 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-957276fd-02b2-4788-8de4-e2a7dac0c3a5 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:10 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:54:10 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:10 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-5d010c25-0836-44b0-8863-9cd060b0447b tempest-CreateVolumesFromSnapshotTest-485460378 None] Created reservations ['8dcd42b2-1f8c-4536-b1fc-2835420eeb3b', '88d8cdf7-07ff-49bf-ad50-c526a5879267', '79d5dc2a-c472-4294-986f-af581a05cca0', 'd7062641-08d3-4e0b-9376-d19d4914a1e6'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5d010c25-0836-44b0-8863-9cd060b0447b tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5d010c25-0836-44b0-8863-9cd060b0447b tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:11 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5d010c25-0836-44b0-8863-9cd060b0447b tempest-CreateVolumesFromSnapshotTest-485460378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:11 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5d010c25-0836-44b0-8863-9cd060b0447b tempest-CreateVolumesFromSnapshotTest-485460378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5d010c25-0836-44b0-8863-9cd060b0447b tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5d010c25-0836-44b0-8863-9cd060b0447b tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:11 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-957276fd-02b2-4788-8de4-e2a7dac0c3a5 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.305s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:11 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-957276fd-02b2-4788-8de4-e2a7dac0c3a5 tempest-VolumesSnapshotTestJSON-1837012040 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:54:11 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:54:11 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:11 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-957276fd-02b2-4788-8de4-e2a7dac0c3a5 tempest-VolumesSnapshotTestJSON-1837012040 None] Deleted volume successfully. Nov 05 03:54:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-957276fd-02b2-4788-8de4-e2a7dac0c3a5 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-94753541-67b1-44ab-ae12-577c514f3303-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:11 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5d010c25-0836-44b0-8863-9cd060b0447b tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.393s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:11 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-5d010c25-0836-44b0-8863-9cd060b0447b tempest-CreateVolumesFromSnapshotTest-485460378 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:54:11 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5d010c25-0836-44b0-8863-9cd060b0447b tempest-CreateVolumesFromSnapshotTest-485460378 None] Deleted volume successfully. Nov 05 03:54:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5d010c25-0836-44b0-8863-9cd060b0447b tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-60b04144-ed6f-475b-92c7-3a7ba1c22bf0-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c6af6b3a-42a3-451b-8254-ac5efc4eb2c4 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-42946ebc-a370-413c-9d1a-8ba80682c3cd-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c6af6b3a-42a3-451b-8254-ac5efc4eb2c4 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-42946ebc-a370-413c-9d1a-8ba80682c3cd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c6af6b3a-42a3-451b-8254-ac5efc4eb2c4 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "cinder-quobyte-42946ebc-a370-413c-9d1a-8ba80682c3cd" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c6af6b3a-42a3-451b-8254-ac5efc4eb2c4 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-42946ebc-a370-413c-9d1a-8ba80682c3cd" acquired by "delete_volume" :: waited 0.013s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:11 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c66bce-4218-4898-975b-703b7fcd5874]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c6af6b3a-42a3-451b-8254-ac5efc4eb2c4 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:11 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd Nov 05 03:54:11 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3ff8a4c5-b72c-408a-940b-efbfd1dd036d tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "cinder-22df2b0c-2e14-41b0-ae6e-727f702fdfdf-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3ff8a4c5-b72c-408a-940b-efbfd1dd036d tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-22df2b0c-2e14-41b0-ae6e-727f702fdfdf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3ff8a4c5-b72c-408a-940b-efbfd1dd036d tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "cinder-quobyte-22df2b0c-2e14-41b0-ae6e-727f702fdfdf" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3ff8a4c5-b72c-408a-940b-efbfd1dd036d tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-quobyte-22df2b0c-2e14-41b0-ae6e-727f702fdfdf" acquired by "delete_volume" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[64357cf0-41b7-4c70-974f-57196c04ab21]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3ff8a4c5-b72c-408a-940b-efbfd1dd036d tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-22df2b0c-2e14-41b0-ae6e-727f702fdfdf {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:12 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c6af6b3a-42a3-451b-8254-ac5efc4eb2c4 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd" returned: 0 in 0.410s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c6af6b3a-42a3-451b-8254-ac5efc4eb2c4 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:12 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd Nov 05 03:54:12 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:12 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-22df2b0c-2e14-41b0-ae6e-727f702fdfdf Nov 05 03:54:12 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:54:12 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Flow 'volume_create_manager' (bde80407-b37a-460b-b5cd-376d9d3f23ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (288cb864-2185-4dbe-bdf9-5d4d2c11b3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c6af6b3a-42a3-451b-8254-ac5efc4eb2c4 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42946ebc-a370-413c-9d1a-8ba80682c3cd" returned: 0 in 0.296s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (288cb864-2185-4dbe-bdf9-5d4d2c11b3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-844675562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee363d1-29ef-4945-9286-622c3d26869d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5a6d7620d354028b1746d10297df91e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:12Z,use_quota=True,user_id='5679d5fabec449b8a559de033f9498f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfc44fd-9b1e-4a1b-85d1-7efc3eb64515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfc44fd-9b1e-4a1b-85d1-7efc3eb64515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4c5f72-8f1e-4f1f-85dc-e6ae7fa75d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4c5f72-8f1e-4f1f-85dc-e6ae7fa75d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eee363d1-29ef-4945-9286-622c3d26869d', 'volume_name': 'volume-eee363d1-29ef-4945-9286-622c3d26869d', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70fa583e-cc92-4897-ab33-046d118f62e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70fa583e-cc92-4897-ab33-046d118f62e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7618723-e0ab-4318-8f0a-10faf658c138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:12 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Volume eee363d1-29ef-4945-9286-622c3d26869d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eee363d1-29ef-4945-9286-622c3d26869d', 'volume_size': 1} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-844675562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee363d1-29ef-4945-9286-622c3d26869d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5a6d7620d354028b1746d10297df91e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:12Z,use_quota=True,user_id='5679d5fabec449b8a559de033f9498f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Creating volume eee363d1-29ef-4945-9286-622c3d26869d {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:54:12 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c6af6b3a-42a3-451b-8254-ac5efc4eb2c4 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-quobyte-42946ebc-a370-413c-9d1a-8ba80682c3cd" released by "delete_volume" :: held 0.839s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:12 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d 1073741824 Nov 05 03:54:12 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:12 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3ff8a4c5-b72c-408a-940b-efbfd1dd036d tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-22df2b0c-2e14-41b0-ae6e-727f702fdfdf" returned: 0 in 0.459s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3ff8a4c5-b72c-408a-940b-efbfd1dd036d tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-22df2b0c-2e14-41b0-ae6e-727f702fdfdf {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:12 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-22df2b0c-2e14-41b0-ae6e-727f702fdfdf Nov 05 03:54:12 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-c6af6b3a-42a3-451b-8254-ac5efc4eb2c4 tempest-VolumesSnapshotTestJSON-1837012040 None] Created reservations ['cf8bf701-fe6d-4615-94fb-841dce8408bd', '74b7da13-de71-4dc1-91d0-b2a45d9bcc04', '8582bd15-5075-4887-8b80-df4558879703', 'f75af55c-2188-47ec-9670-e613fdf4e946'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c6af6b3a-42a3-451b-8254-ac5efc4eb2c4 tempest-VolumesSnapshotTestJSON-1837012040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c6af6b3a-42a3-451b-8254-ac5efc4eb2c4 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c6af6b3a-42a3-451b-8254-ac5efc4eb2c4 tempest-VolumesSnapshotTestJSON-1837012040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c6af6b3a-42a3-451b-8254-ac5efc4eb2c4 tempest-VolumesSnapshotTestJSON-1837012040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c6af6b3a-42a3-451b-8254-ac5efc4eb2c4 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c6af6b3a-42a3-451b-8254-ac5efc4eb2c4 tempest-VolumesSnapshotTestJSON-1837012040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:12 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:54:12 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:12 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3ff8a4c5-b72c-408a-940b-efbfd1dd036d tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-22df2b0c-2e14-41b0-ae6e-727f702fdfdf" returned: 0 in 0.267s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3ff8a4c5-b72c-408a-940b-efbfd1dd036d tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-quobyte-22df2b0c-2e14-41b0-ae6e-727f702fdfdf" released by "delete_volume" :: held 0.777s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-3ff8a4c5-b72c-408a-940b-efbfd1dd036d tempest-CreateVolumesFromSnapshotTest-485460378 None] Created reservations ['f695d261-f73d-46f4-85e8-4707e3074cd0', 'b0c8420c-1853-42e7-b289-88ba4fdb02a8', 'a0af46b2-6aad-4d6c-b38b-c2289c8a6fab', '665b9658-c232-4b75-a1c7-56251dc4884f'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:13 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c6af6b3a-42a3-451b-8254-ac5efc4eb2c4 tempest-VolumesSnapshotTestJSON-1837012040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.283s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-c6af6b3a-42a3-451b-8254-ac5efc4eb2c4 tempest-VolumesSnapshotTestJSON-1837012040 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:54:13 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-c6af6b3a-42a3-451b-8254-ac5efc4eb2c4 tempest-VolumesSnapshotTestJSON-1837012040 None] Deleted volume successfully. Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3ff8a4c5-b72c-408a-940b-efbfd1dd036d tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3ff8a4c5-b72c-408a-940b-efbfd1dd036d tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3ff8a4c5-b72c-408a-940b-efbfd1dd036d tempest-CreateVolumesFromSnapshotTest-485460378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3ff8a4c5-b72c-408a-940b-efbfd1dd036d tempest-CreateVolumesFromSnapshotTest-485460378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3ff8a4c5-b72c-408a-940b-efbfd1dd036d tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3ff8a4c5-b72c-408a-940b-efbfd1dd036d tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:13 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c6af6b3a-42a3-451b-8254-ac5efc4eb2c4 tempest-VolumesSnapshotTestJSON-1837012040 None] Lock "cinder-42946ebc-a370-413c-9d1a-8ba80682c3cd-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:13 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:13 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d 1073741824" returned: 0 in 0.576s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-61c4c55b-c9bd-4330-97a6-fc0e60e2aa96 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "cinder-6a379d5b-0f33-4326-b20c-f996ff708f74-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:13 devstack sudo[101042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d Nov 05 03:54:13 devstack sudo[101042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-61c4c55b-c9bd-4330-97a6-fc0e60e2aa96 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-6a379d5b-0f33-4326-b20c-f996ff708f74-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-61c4c55b-c9bd-4330-97a6-fc0e60e2aa96 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "cinder-quobyte-6a379d5b-0f33-4326-b20c-f996ff708f74" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-61c4c55b-c9bd-4330-97a6-fc0e60e2aa96 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-quobyte-6a379d5b-0f33-4326-b20c-f996ff708f74" acquired by "delete_volume" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[90138f67-7309-42ff-a6af-1536882336fc]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-61c4c55b-c9bd-4330-97a6-fc0e60e2aa96 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a379d5b-0f33-4326-b20c-f996ff708f74 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:13 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3ff8a4c5-b72c-408a-940b-efbfd1dd036d tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.384s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-3ff8a4c5-b72c-408a-940b-efbfd1dd036d tempest-CreateVolumesFromSnapshotTest-485460378 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:54:13 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-3ff8a4c5-b72c-408a-940b-efbfd1dd036d tempest-CreateVolumesFromSnapshotTest-485460378 None] Deleted volume successfully. Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3ff8a4c5-b72c-408a-940b-efbfd1dd036d tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-22df2b0c-2e14-41b0-ae6e-727f702fdfdf-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:13 devstack sudo[101042]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d" returned: 0 in 0.322s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:13 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a379d5b-0f33-4326-b20c-f996ff708f74 Nov 05 03:54:13 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7618723-e0ab-4318-8f0a-10faf658c138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eee363d1-29ef-4945-9286-622c3d26869d', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b16f9d-74ab-4a13-8f8f-efee016f451a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:13 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Volume volume-eee363d1-29ef-4945-9286-622c3d26869d (eee363d1-29ef-4945-9286-622c3d26869d): created successfully Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b16f9d-74ab-4a13-8f8f-efee016f451a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Flow 'volume_create_manager' (bde80407-b37a-460b-b5cd-376d9d3f23ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:13 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-a735e3b5-4b27-4be2-91b0-a0a538c760b2 tempest-VolumesActionsTest-1065425865 None] Created volume successfully. Nov 05 03:54:13 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-61c4c55b-c9bd-4330-97a6-fc0e60e2aa96 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a379d5b-0f33-4326-b20c-f996ff708f74" returned: 0 in 0.435s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-61c4c55b-c9bd-4330-97a6-fc0e60e2aa96 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a379d5b-0f33-4326-b20c-f996ff708f74 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:13 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a379d5b-0f33-4326-b20c-f996ff708f74 Nov 05 03:54:13 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:14 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-61c4c55b-c9bd-4330-97a6-fc0e60e2aa96 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6a379d5b-0f33-4326-b20c-f996ff708f74" returned: 0 in 0.264s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-61c4c55b-c9bd-4330-97a6-fc0e60e2aa96 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-quobyte-6a379d5b-0f33-4326-b20c-f996ff708f74" released by "delete_volume" :: held 0.781s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:14 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-61c4c55b-c9bd-4330-97a6-fc0e60e2aa96 tempest-CreateVolumesFromSnapshotTest-485460378 None] Created reservations ['e0e433cd-0459-4c2c-9f35-777d684bbfd3', '6f83598f-652d-4d28-8518-d0d3fefe09f0', '6705e295-bf01-483f-8226-b587df4545ed', 'e239ed59-51a9-4862-9d9c-ad4695ad2025'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-61c4c55b-c9bd-4330-97a6-fc0e60e2aa96 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-61c4c55b-c9bd-4330-97a6-fc0e60e2aa96 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-61c4c55b-c9bd-4330-97a6-fc0e60e2aa96 tempest-CreateVolumesFromSnapshotTest-485460378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-61c4c55b-c9bd-4330-97a6-fc0e60e2aa96 tempest-CreateVolumesFromSnapshotTest-485460378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-61c4c55b-c9bd-4330-97a6-fc0e60e2aa96 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-61c4c55b-c9bd-4330-97a6-fc0e60e2aa96 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:14 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:54:14 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-90a3bc1f-4dc8-4559-908d-874605003538 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "cinder-6cdf7674-6752-495e-b37b-f3fe13b46454-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-90a3bc1f-4dc8-4559-908d-874605003538 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-6cdf7674-6752-495e-b37b-f3fe13b46454-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:14 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-61c4c55b-c9bd-4330-97a6-fc0e60e2aa96 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.348s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:14 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-61c4c55b-c9bd-4330-97a6-fc0e60e2aa96 tempest-CreateVolumesFromSnapshotTest-485460378 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:54:14 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-61c4c55b-c9bd-4330-97a6-fc0e60e2aa96 tempest-CreateVolumesFromSnapshotTest-485460378 None] Deleted volume successfully. Nov 05 03:54:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-90a3bc1f-4dc8-4559-908d-874605003538 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "cinder-quobyte-6cdf7674-6752-495e-b37b-f3fe13b46454" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-61c4c55b-c9bd-4330-97a6-fc0e60e2aa96 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-6a379d5b-0f33-4326-b20c-f996ff708f74-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-90a3bc1f-4dc8-4559-908d-874605003538 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-quobyte-6cdf7674-6752-495e-b37b-f3fe13b46454" acquired by "delete_volume" :: waited 0.025s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:14 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0b9c16-8d41-43d4-a10f-00b8f88ed3b9]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90a3bc1f-4dc8-4559-908d-874605003538 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6cdf7674-6752-495e-b37b-f3fe13b46454 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:14 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6cdf7674-6752-495e-b37b-f3fe13b46454 Nov 05 03:54:14 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:15 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90a3bc1f-4dc8-4559-908d-874605003538 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6cdf7674-6752-495e-b37b-f3fe13b46454" returned: 0 in 0.385s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90a3bc1f-4dc8-4559-908d-874605003538 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6cdf7674-6752-495e-b37b-f3fe13b46454 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:15 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6cdf7674-6752-495e-b37b-f3fe13b46454 Nov 05 03:54:15 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:15 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90a3bc1f-4dc8-4559-908d-874605003538 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6cdf7674-6752-495e-b37b-f3fe13b46454" returned: 0 in 0.267s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-90a3bc1f-4dc8-4559-908d-874605003538 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-quobyte-6cdf7674-6752-495e-b37b-f3fe13b46454" released by "delete_volume" :: held 0.706s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-90a3bc1f-4dc8-4559-908d-874605003538 tempest-CreateVolumesFromSnapshotTest-485460378 None] Created reservations ['ba2876ed-b435-468e-9dde-faa2962fcf6a', '21b5eb2d-2d2b-4b86-9aa5-61d6993c1c06', 'd58f9564-c9f3-46f1-8002-f24b05a85414', 'aac0d0d7-2ce1-4342-8a72-6b309e5a265d'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-90a3bc1f-4dc8-4559-908d-874605003538 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-90a3bc1f-4dc8-4559-908d-874605003538 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-90a3bc1f-4dc8-4559-908d-874605003538 tempest-CreateVolumesFromSnapshotTest-485460378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-90a3bc1f-4dc8-4559-908d-874605003538 tempest-CreateVolumesFromSnapshotTest-485460378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-90a3bc1f-4dc8-4559-908d-874605003538 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90a3bc1f-4dc8-4559-908d-874605003538 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:15 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:54:15 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "cinder-af7f879a-1790-45db-8755-eceaa74e460c-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-af7f879a-1790-45db-8755-eceaa74e460c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "cinder-quobyte-02145b29-4935-4fd9-9fed-041a9a9cbfd3" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-quobyte-02145b29-4935-4fd9-9fed-041a9a9cbfd3" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "cinder-quobyte-af7f879a-1790-45db-8755-eceaa74e460c" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-quobyte-af7f879a-1790-45db-8755-eceaa74e460c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] Deleting offline snapshot af7f879a-1790-45db-8755-eceaa74e460c of volume 02145b29-4935-4fd9-9fed-041a9a9cbfd3 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] snapshot_file for this snap is: volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.af7f879a-1790-45db-8755-eceaa74e460c {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c96d70-9771-4c03-959f-47ffaab9eeb1]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.af7f879a-1790-45db-8755-eceaa74e460c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:15 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-90a3bc1f-4dc8-4559-908d-874605003538 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.397s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-90a3bc1f-4dc8-4559-908d-874605003538 tempest-CreateVolumesFromSnapshotTest-485460378 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:54:15 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-90a3bc1f-4dc8-4559-908d-874605003538 tempest-CreateVolumesFromSnapshotTest-485460378 None] Deleted volume successfully. Nov 05 03:54:15 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-90a3bc1f-4dc8-4559-908d-874605003538 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-6cdf7674-6752-495e-b37b-f3fe13b46454-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:16 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.af7f879a-1790-45db-8755-eceaa74e460c Nov 05 03:54:16 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:16 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.af7f879a-1790-45db-8755-eceaa74e460c" returned: 0 in 0.422s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:54:16 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ddb1ed-ebeb-4778-a811-7e76580a08dc]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:16 devstack sudo[101079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3 Nov 05 03:54:16 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:16 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3" returned: 0 in 0.449s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.af7f879a-1790-45db-8755-eceaa74e460c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:16 devstack sudo[101084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.af7f879a-1790-45db-8755-eceaa74e460c Nov 05 03:54:16 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:17 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.af7f879a-1790-45db-8755-eceaa74e460c" returned: 0 in 0.550s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.af7f879a-1790-45db-8755-eceaa74e460c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:17 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.af7f879a-1790-45db-8755-eceaa74e460c Nov 05 03:54:17 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:17 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3.af7f879a-1790-45db-8755-eceaa74e460c" returned: 0 in 0.309s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:17 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-quobyte-af7f879a-1790-45db-8755-eceaa74e460c" released by "_delete_snapshot" :: held 1.899s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:17 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-quobyte-02145b29-4935-4fd9-9fed-041a9a9cbfd3" released by "delete_snapshot" :: held 1.929s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:17 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] Created reservations ['8a735b78-680d-41f3-8927-ce99d6073210', '859438d4-0e94-4e3c-a9df-7c1c65cf9f37', 'af227255-8152-44e8-be7b-4d2a90d135c8', 'e66cc582-8d92-4969-adce-1bdbaa8415f7'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:17 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] Delete snapshot completed successfully. Nov 05 03:54:17 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-ac6fcecf-3efa-4a1e-9e0f-a9fba4fb6053 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-af7f879a-1790-45db-8755-eceaa74e460c-delete_snapshot" released by "delete_snapshot" :: held 2.191s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:19 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c00b3f9a-6ef9-4f00-96d9-668d08916c43 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "cinder-02145b29-4935-4fd9-9fed-041a9a9cbfd3-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:19 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c00b3f9a-6ef9-4f00-96d9-668d08916c43 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-02145b29-4935-4fd9-9fed-041a9a9cbfd3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:19 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c00b3f9a-6ef9-4f00-96d9-668d08916c43 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "cinder-quobyte-02145b29-4935-4fd9-9fed-041a9a9cbfd3" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:19 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c00b3f9a-6ef9-4f00-96d9-668d08916c43 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-quobyte-02145b29-4935-4fd9-9fed-041a9a9cbfd3" acquired by "delete_volume" :: waited 0.018s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:19 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cb51cd-fe4f-4722-88b0-1ad578cbe111]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c00b3f9a-6ef9-4f00-96d9-668d08916c43 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:19 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3 Nov 05 03:54:19 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:19 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c00b3f9a-6ef9-4f00-96d9-668d08916c43 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3" returned: 0 in 0.471s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c00b3f9a-6ef9-4f00-96d9-668d08916c43 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:19 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3 Nov 05 03:54:19 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:19 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c00b3f9a-6ef9-4f00-96d9-668d08916c43 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-02145b29-4935-4fd9-9fed-041a9a9cbfd3" returned: 0 in 0.299s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:19 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c00b3f9a-6ef9-4f00-96d9-668d08916c43 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-quobyte-02145b29-4935-4fd9-9fed-041a9a9cbfd3" released by "delete_volume" :: held 0.872s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:20 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-c00b3f9a-6ef9-4f00-96d9-668d08916c43 tempest-CreateVolumesFromSnapshotTest-485460378 None] Created reservations ['c15bfaaa-e40b-433d-a6a4-10c6b19c9c70', '1b9ad3b2-66c4-41d5-8ef7-062b56937588', '3335605c-c747-48d5-804a-20184771c68c', 'aeb23410-0b30-40ac-93d1-e26a67d0b4c4'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c00b3f9a-6ef9-4f00-96d9-668d08916c43 tempest-CreateVolumesFromSnapshotTest-485460378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c00b3f9a-6ef9-4f00-96d9-668d08916c43 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c00b3f9a-6ef9-4f00-96d9-668d08916c43 tempest-CreateVolumesFromSnapshotTest-485460378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c00b3f9a-6ef9-4f00-96d9-668d08916c43 tempest-CreateVolumesFromSnapshotTest-485460378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c00b3f9a-6ef9-4f00-96d9-668d08916c43 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c00b3f9a-6ef9-4f00-96d9-668d08916c43 tempest-CreateVolumesFromSnapshotTest-485460378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:20 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:54:20 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:20 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c00b3f9a-6ef9-4f00-96d9-668d08916c43 tempest-CreateVolumesFromSnapshotTest-485460378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.508s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:20 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-c00b3f9a-6ef9-4f00-96d9-668d08916c43 tempest-CreateVolumesFromSnapshotTest-485460378 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:54:20 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-c00b3f9a-6ef9-4f00-96d9-668d08916c43 tempest-CreateVolumesFromSnapshotTest-485460378 None] Deleted volume successfully. Nov 05 03:54:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c00b3f9a-6ef9-4f00-96d9-668d08916c43 tempest-CreateVolumesFromSnapshotTest-485460378 None] Lock "cinder-02145b29-4935-4fd9-9fed-041a9a9cbfd3-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c37d96ba-8eff-4bd2-99b3-984c0fc04189 tempest-VolumesActionsTest-1065425865 None] Acquiring lock "cinder-eee363d1-29ef-4945-9286-622c3d26869d" by "attach_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c37d96ba-8eff-4bd2-99b3-984c0fc04189 tempest-VolumesActionsTest-1065425865 None] Lock "cinder-eee363d1-29ef-4945-9286-622c3d26869d" acquired by "attach_volume" :: waited 0.026s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:23 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-c37d96ba-8eff-4bd2-99b3-984c0fc04189 tempest-VolumesActionsTest-1065425865 None] Attaching volume eee363d1-29ef-4945-9286-622c3d26869d to instance 6aabdff1-470e-4ce2-baa6-f0f4b5973e9b at mountpoint /dev/vdb on host None. Nov 05 03:54:23 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-c37d96ba-8eff-4bd2-99b3-984c0fc04189 tempest-VolumesActionsTest-1065425865 None] Attach volume completed successfully. Nov 05 03:54:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c37d96ba-8eff-4bd2-99b3-984c0fc04189 tempest-VolumesActionsTest-1065425865 None] Lock "cinder-eee363d1-29ef-4945-9286-622c3d26869d" released by "attach_volume" :: held 0.141s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3f8b0b5d-3643-4213-adf8-9a0dceb1fbb0 tempest-VolumesActionsTest-1065425865 None] Acquiring lock "cinder-eee363d1-29ef-4945-9286-622c3d26869d-detach_volume" by "detach_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3f8b0b5d-3643-4213-adf8-9a0dceb1fbb0 tempest-VolumesActionsTest-1065425865 None] Lock "cinder-eee363d1-29ef-4945-9286-622c3d26869d-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:23 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-3f8b0b5d-3643-4213-adf8-9a0dceb1fbb0 tempest-VolumesActionsTest-1065425865 None] Detaching volume eee363d1-29ef-4945-9286-622c3d26869d from instance 6aabdff1-470e-4ce2-baa6-f0f4b5973e9b. Nov 05 03:54:23 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-3f8b0b5d-3643-4213-adf8-9a0dceb1fbb0 tempest-VolumesActionsTest-1065425865 None] Detach volume completed successfully. Nov 05 03:54:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3f8b0b5d-3643-4213-adf8-9a0dceb1fbb0 tempest-VolumesActionsTest-1065425865 None] Lock "cinder-eee363d1-29ef-4945-9286-622c3d26869d-detach_volume" released by "detach_volume" :: held 0.091s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Flow 'volume_create_manager' (1997b691-99e9-4e2e-9e77-55fc7e68d581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4707433a-6456-41dd-9cac-c756379b9b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4707433a-6456-41dd-9cac-c756379b9b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2061565710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e088368e-8a94-4761-a9ee-474fa06e0846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87523cc670af49d4bf192bcbc931cb79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:25Z,use_quota=True,user_id='69e98eb838cf4c298c50a81e5a24bed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a7c465-7881-4a95-a32b-b99c75afa478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a7c465-7881-4a95-a32b-b99c75afa478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ff7b2e-3bbc-42dd-a7e5-0a2b896364b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ff7b2e-3bbc-42dd-a7e5-0a2b896364b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e088368e-8a94-4761-a9ee-474fa06e0846', 'volume_name': 'volume-e088368e-8a94-4761-a9ee-474fa06e0846', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a681a0e5-3d6a-4731-ab95-a0ab81398ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a681a0e5-3d6a-4731-ab95-a0ab81398ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54779349-ec99-47e4-9f13-6f5961d854f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:25 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Volume e088368e-8a94-4761-a9ee-474fa06e0846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e088368e-8a94-4761-a9ee-474fa06e0846', 'volume_size': 1} Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2061565710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e088368e-8a94-4761-a9ee-474fa06e0846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87523cc670af49d4bf192bcbc931cb79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:25Z,use_quota=True,user_id='69e98eb838cf4c298c50a81e5a24bed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Creating volume e088368e-8a94-4761-a9ee-474fa06e0846 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:54:25 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:54:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:25 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846 1073741824 Nov 05 03:54:25 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:26 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846 1073741824" returned: 0 in 0.558s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:26 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846 Nov 05 03:54:26 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:26 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846" returned: 0 in 0.421s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:54:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:26 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54779349-ec99-47e4-9f13-6f5961d854f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e088368e-8a94-4761-a9ee-474fa06e0846', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:26 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3accf2df-f951-49c6-8d84-7a49e7a59382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:26 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Volume volume-e088368e-8a94-4761-a9ee-474fa06e0846 (e088368e-8a94-4761-a9ee-474fa06e0846): created successfully Nov 05 03:54:26 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3accf2df-f951-49c6-8d84-7a49e7a59382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:26 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Flow 'volume_create_manager' (1997b691-99e9-4e2e-9e77-55fc7e68d581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:26 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-321af23b-66b7-4ed8-b64c-32c76a4260b9 tempest-VolumeDependencyTests-965510731 None] Created volume successfully. Nov 05 03:54:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8e4aae7e-58ab-4224-a5c7-5d1f91d7d8d2 tempest-VolumeDependencyTests-965510731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8e4aae7e-58ab-4224-a5c7-5d1f91d7d8d2 tempest-VolumeDependencyTests-965510731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:28 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-8e4aae7e-58ab-4224-a5c7-5d1f91d7d8d2 tempest-VolumeDependencyTests-965510731 None] Creating offline snapshot ea0e2882-9af6-4574-9132-896b92c21d4b of volume e088368e-8a94-4761-a9ee-474fa06e0846 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:54:28 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb49e00-06af-474c-81e3-c79eb62997de]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e4aae7e-58ab-4224-a5c7-5d1f91d7d8d2 tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:28 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846 Nov 05 03:54:28 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:28 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e4aae7e-58ab-4224-a5c7-5d1f91d7d8d2 tempest-VolumeDependencyTests-965510731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846" returned: 0 in 0.408s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e4aae7e-58ab-4224-a5c7-5d1f91d7d8d2 tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:28 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b 1G Nov 05 03:54:28 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:28 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e4aae7e-58ab-4224-a5c7-5d1f91d7d8d2 tempest-VolumeDependencyTests-965510731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b 1G" returned: 0 in 0.511s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e4aae7e-58ab-4224-a5c7-5d1f91d7d8d2 tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e088368e-8a94-4761-a9ee-474fa06e0846 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:28 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e088368e-8a94-4761-a9ee-474fa06e0846 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b Nov 05 03:54:28 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:29 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e4aae7e-58ab-4224-a5c7-5d1f91d7d8d2 tempest-VolumeDependencyTests-965510731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e088368e-8a94-4761-a9ee-474fa06e0846 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b" returned: 0 in 0.437s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:29 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-8e4aae7e-58ab-4224-a5c7-5d1f91d7d8d2 tempest-VolumeDependencyTests-965510731 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b is being set with open permissions: ugo+rw Nov 05 03:54:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e4aae7e-58ab-4224-a5c7-5d1f91d7d8d2 tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:29 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b Nov 05 03:54:29 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:29 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e4aae7e-58ab-4224-a5c7-5d1f91d7d8d2 tempest-VolumeDependencyTests-965510731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b" returned: 0 in 0.437s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e4aae7e-58ab-4224-a5c7-5d1f91d7d8d2 tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:29 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.info Nov 05 03:54:29 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:30 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e4aae7e-58ab-4224-a5c7-5d1f91d7d8d2 tempest-VolumeDependencyTests-965510731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.info" returned: 0 in 0.341s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:30 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-8e4aae7e-58ab-4224-a5c7-5d1f91d7d8d2 tempest-VolumeDependencyTests-965510731 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.info is being set with open permissions: ugo+rw Nov 05 03:54:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e4aae7e-58ab-4224-a5c7-5d1f91d7d8d2 tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:30 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.info Nov 05 03:54:30 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:30 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e4aae7e-58ab-4224-a5c7-5d1f91d7d8d2 tempest-VolumeDependencyTests-965510731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.info" returned: 0 in 0.362s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8e4aae7e-58ab-4224-a5c7-5d1f91d7d8d2 tempest-VolumeDependencyTests-965510731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.651s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:30 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:UPDATE=189,cinder:SELECT=175,cinder:INSERT=57,cinder:DELETE=18 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:54:30 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-8e4aae7e-58ab-4224-a5c7-5d1f91d7d8d2 tempest-VolumeDependencyTests-965510731 None] Create snapshot completed successfully Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Flow 'volume_create_manager' (575f2b3f-f5b2-40cc-9bca-39f401109d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554f5b90-bb31-4b43-b364-25bd83715f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554f5b90-bb31-4b43-b364-25bd83715f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-478001734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=624d1818-3160-4f22-8aa1-fb661124d3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87523cc670af49d4bf192bcbc931cb79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ea0e2882-9af6-4574-9132-896b92c21d4b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:54:32Z,use_quota=True,user_id='69e98eb838cf4c298c50a81e5a24bed5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e935800-b911-4282-8744-6dae44014eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e935800-b911-4282-8744-6dae44014eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1e64f7-1899-439d-888e-40e78f79bbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1e64f7-1899-439d-888e-40e78f79bbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '624d1818-3160-4f22-8aa1-fb661124d3d6', 'volume_name': 'volume-624d1818-3160-4f22-8aa1-fb661124d3d6', 'volume_size': 1, 'snapshot_id': 'ea0e2882-9af6-4574-9132-896b92c21d4b'}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f191ee7f-175d-4447-adf5-d185d37d6ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f191ee7f-175d-4447-adf5-d185d37d6ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b3dc63-fef0-4e9e-9617-c369e6e75546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:31 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Volume 624d1818-3160-4f22-8aa1-fb661124d3d6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-624d1818-3160-4f22-8aa1-fb661124d3d6', 'volume_size': 1, 'snapshot_id': 'ea0e2882-9af6-4574-9132-896b92c21d4b'} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=160,cinder:INSERT=49,cinder:UPDATE=205,cinder:DELETE=15 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Acquiring lock "cinder-quobyte-ea0e2882-9af6-4574-9132-896b92c21d4b-624d1818-3160-4f22-8aa1-fb661124d3d6" by "_create_volume_from_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Lock "cinder-quobyte-ea0e2882-9af6-4574-9132-896b92c21d4b-624d1818-3160-4f22-8aa1-fb661124d3d6" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Creating volume 624d1818-3160-4f22-8aa1-fb661124d3d6 from snapshot ea0e2882-9af6-4574-9132-896b92c21d4b {{(pid=87109) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:54:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Acquiring lock "cinder-quobyte-624d1818-3160-4f22-8aa1-fb661124d3d6" by "_copy_volume_from_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Lock "cinder-quobyte-624d1818-3160-4f22-8aa1-fb661124d3d6" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] snapshot: ea0e2882-9af6-4574-9132-896b92c21d4b, volume: 624d1818-3160-4f22-8aa1-fb661124d3d6, {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 03:54:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:32 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1d57bc-a331-4124-b197-985b6ed7f165]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:32 devstack sudo[101278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b Nov 05 03:54:32 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:32 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b" returned: 0 in 0.433s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e088368e-8a94-4761-a9ee-474fa06e0846(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:54:32 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efd3ca8-074a-45c9-b194-eddb87dffdc8]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:32 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846 Nov 05 03:54:32 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:33 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846" returned: 0 in 0.721s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846 {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 03:54:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Creating direct copy from snapshot {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 03:54:33 devstack cinder-volume[87109]: DEBUG cinder.utils [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Path /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-624d1818-3160-4f22-8aa1-fb661124d3d6 not found in is_blk_device check {{(pid=87109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 03:54:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-624d1818-3160-4f22-8aa1-fb661124d3d6 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:33 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-624d1818-3160-4f22-8aa1-fb661124d3d6 Nov 05 03:54:33 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:38 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-dec2a3b2-f95f-4b2b-bf79-fb43c88de349 tempest-VolumesActionsTest-1065425865 None] Acquiring lock "cinder-eee363d1-29ef-4945-9286-622c3d26869d" by "attach_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:38 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-dec2a3b2-f95f-4b2b-bf79-fb43c88de349 tempest-VolumesActionsTest-1065425865 None] Lock "cinder-eee363d1-29ef-4945-9286-622c3d26869d" acquired by "attach_volume" :: waited 0.055s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:38 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-dec2a3b2-f95f-4b2b-bf79-fb43c88de349 tempest-VolumesActionsTest-1065425865 None] Attaching volume eee363d1-29ef-4945-9286-622c3d26869d to instance 466a5f8f-4d81-45d7-ab92-5bd72108795f at mountpoint /dev/vdb on host None. Nov 05 03:54:38 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-dec2a3b2-f95f-4b2b-bf79-fb43c88de349 tempest-VolumesActionsTest-1065425865 None] Attach volume completed successfully. Nov 05 03:54:38 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-dec2a3b2-f95f-4b2b-bf79-fb43c88de349 tempest-VolumesActionsTest-1065425865 None] Lock "cinder-eee363d1-29ef-4945-9286-622c3d26869d" released by "attach_volume" :: held 0.291s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:39 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3e8d1368-39ee-4ecc-b0b5-a82ef9eece38 tempest-VolumesActionsTest-1065425865 None] Acquiring lock "cinder-eee363d1-29ef-4945-9286-622c3d26869d-detach_volume" by "detach_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:39 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3e8d1368-39ee-4ecc-b0b5-a82ef9eece38 tempest-VolumesActionsTest-1065425865 None] Lock "cinder-eee363d1-29ef-4945-9286-622c3d26869d-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:39 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-3e8d1368-39ee-4ecc-b0b5-a82ef9eece38 tempest-VolumesActionsTest-1065425865 None] Detaching volume eee363d1-29ef-4945-9286-622c3d26869d from instance 466a5f8f-4d81-45d7-ab92-5bd72108795f. Nov 05 03:54:39 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-3e8d1368-39ee-4ecc-b0b5-a82ef9eece38 tempest-VolumesActionsTest-1065425865 None] Detach volume completed successfully. Nov 05 03:54:39 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3e8d1368-39ee-4ecc-b0b5-a82ef9eece38 tempest-VolumesActionsTest-1065425865 None] Lock "cinder-eee363d1-29ef-4945-9286-622c3d26869d-detach_volume" released by "detach_volume" :: held 0.202s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:43 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-624d1818-3160-4f22-8aa1-fb661124d3d6" returned: 0 in 9.977s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:43 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Image conversion details: src /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846, size 1024.00 MB, duration 9.98 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-624d1818-3160-4f22-8aa1-fb661124d3d6 {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:54:43 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Converted 1024.00 MB image at 102.63 MB/s Nov 05 03:54:43 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-624d1818-3160-4f22-8aa1-fb661124d3d6 is being set with open permissions: ugo+rw Nov 05 03:54:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-624d1818-3160-4f22-8aa1-fb661124d3d6 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:43 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-624d1818-3160-4f22-8aa1-fb661124d3d6 Nov 05 03:54:43 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:43 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-624d1818-3160-4f22-8aa1-fb661124d3d6" returned: 0 in 0.260s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Lock "cinder-quobyte-624d1818-3160-4f22-8aa1-fb661124d3d6" released by "_copy_volume_from_snapshot" :: held 11.525s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Lock "cinder-quobyte-ea0e2882-9af6-4574-9132-896b92c21d4b-624d1818-3160-4f22-8aa1-fb661124d3d6" released by "_create_volume_from_snapshot" :: held 11.617s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.649s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:43 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b3dc63-fef0-4e9e-9617-c369e6e75546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-624d1818-3160-4f22-8aa1-fb661124d3d6', 'volume_size': 1, 'snapshot_id': 'ea0e2882-9af6-4574-9132-896b92c21d4b'}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:43 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6efc4ad9-b816-4d1f-b172-4d71d8ffd27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:54:43 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Volume volume-624d1818-3160-4f22-8aa1-fb661124d3d6 (624d1818-3160-4f22-8aa1-fb661124d3d6): created successfully Nov 05 03:54:43 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6efc4ad9-b816-4d1f-b172-4d71d8ffd27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:54:43 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Flow 'volume_create_manager' (575f2b3f-f5b2-40cc-9bca-39f401109d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:54:43 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-92b7c44f-0db3-40d3-acc7-a2a2c1b86395 tempest-VolumeDependencyTests-965510731 None] Created volume successfully. Nov 05 03:54:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] Acquiring lock "cinder-ea0e2882-9af6-4574-9132-896b92c21d4b-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] Lock "cinder-ea0e2882-9af6-4574-9132-896b92c21d4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] Acquiring lock "cinder-quobyte-e088368e-8a94-4761-a9ee-474fa06e0846" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] Lock "cinder-quobyte-e088368e-8a94-4761-a9ee-474fa06e0846" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] Acquiring lock "cinder-quobyte-ea0e2882-9af6-4574-9132-896b92c21d4b" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] Lock "cinder-quobyte-ea0e2882-9af6-4574-9132-896b92c21d4b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] Deleting offline snapshot ea0e2882-9af6-4574-9132-896b92c21d4b of volume e088368e-8a94-4761-a9ee-474fa06e0846 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:54:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] snapshot_file for this snap is: volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:54:44 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba93616-5c46-4c21-ab13-b9d662dc2870]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:44 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b Nov 05 03:54:44 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:45 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b" returned: 0 in 0.483s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:45 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e088368e-8a94-4761-a9ee-474fa06e0846(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:54:45 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab08ebf6-865b-40d4-bf34-6bb52843fb7b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:45 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846 Nov 05 03:54:45 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:45 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846" returned: 0 in 0.699s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:45 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b Nov 05 03:54:45 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:46 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b" returned: 0 in 0.361s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:46 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b Nov 05 03:54:46 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ae412c79-4a30-4c7b-81ef-ddcfae9c9497 tempest-VolumesActionsTest-1065425865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ae412c79-4a30-4c7b-81ef-ddcfae9c9497 tempest-VolumesActionsTest-1065425865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:46 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1007b15-5ff3-440f-9d66-f73258fb0b83]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ae412c79-4a30-4c7b-81ef-ddcfae9c9497 tempest-VolumesActionsTest-1065425865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:46 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846.ea0e2882-9af6-4574-9132-896b92c21d4b" returned: 0 in 0.306s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:46 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d Nov 05 03:54:46 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] Lock "cinder-quobyte-ea0e2882-9af6-4574-9132-896b92c21d4b" released by "_delete_snapshot" :: held 1.983s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] Lock "cinder-quobyte-e088368e-8a94-4761-a9ee-474fa06e0846" released by "delete_snapshot" :: held 2.019s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:46 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] Created reservations ['ea14cfbb-e725-49df-b8b8-efc02dc1ceda', '10ecc925-fdcf-4be6-8d8d-1e29c119bb14', '14bfd7d1-1f2a-4bda-8658-0d23fc58206b', '888ad500-f367-4d55-9fc0-4f21eff67c7e'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:46 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] Delete snapshot completed successfully. Nov 05 03:54:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b9ecef63-43fe-4221-9c04-6d2ea03a6c94 tempest-VolumeDependencyTests-965510731 None] Lock "cinder-ea0e2882-9af6-4574-9132-896b92c21d4b-delete_snapshot" released by "delete_snapshot" :: held 2.185s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:46 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ae412c79-4a30-4c7b-81ef-ddcfae9c9497 tempest-VolumesActionsTest-1065425865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d" returned: 0 in 0.539s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:46 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de928c9-0ff5-4458-b966-ddd1a19d0151]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ae412c79-4a30-4c7b-81ef-ddcfae9c9497 tempest-VolumesActionsTest-1065425865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:46 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d Nov 05 03:54:46 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:47 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ae412c79-4a30-4c7b-81ef-ddcfae9c9497 tempest-VolumesActionsTest-1065425865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d" returned: 0 in 0.415s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ae412c79-4a30-4c7b-81ef-ddcfae9c9497 tempest-VolumesActionsTest-1065425865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d /opt/stack/data/cinder/conversion/eee363d1-29ef-4945-9286-622c3d26869d.temp_image.b97ce13c-8c86-4042-a860-5ba2be4d336c3q8yy2lh.img {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:47 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d /opt/stack/data/cinder/conversion/eee363d1-29ef-4945-9286-622c3d26869d.temp_image.b97ce13c-8c86-4042-a860-5ba2be4d336c3q8yy2lh.img Nov 05 03:54:47 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a513dab4-dcf0-4f33-ad57-5ee8f3802a8e tempest-VolumeDependencyTests-965510731 None] Acquiring lock "cinder-e088368e-8a94-4761-a9ee-474fa06e0846-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a513dab4-dcf0-4f33-ad57-5ee8f3802a8e tempest-VolumeDependencyTests-965510731 None] Lock "cinder-e088368e-8a94-4761-a9ee-474fa06e0846-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a513dab4-dcf0-4f33-ad57-5ee8f3802a8e tempest-VolumeDependencyTests-965510731 None] Acquiring lock "cinder-quobyte-e088368e-8a94-4761-a9ee-474fa06e0846" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a513dab4-dcf0-4f33-ad57-5ee8f3802a8e tempest-VolumeDependencyTests-965510731 None] Lock "cinder-quobyte-e088368e-8a94-4761-a9ee-474fa06e0846" acquired by "delete_volume" :: waited 0.044s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:48 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ec078a-3a0e-4608-b163-e053c311ae71]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a513dab4-dcf0-4f33-ad57-5ee8f3802a8e tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:48 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846 Nov 05 03:54:48 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:48 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a513dab4-dcf0-4f33-ad57-5ee8f3802a8e tempest-VolumeDependencyTests-965510731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846" returned: 0 in 0.638s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a513dab4-dcf0-4f33-ad57-5ee8f3802a8e tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:48 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846 Nov 05 03:54:48 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:49 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a513dab4-dcf0-4f33-ad57-5ee8f3802a8e tempest-VolumeDependencyTests-965510731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e088368e-8a94-4761-a9ee-474fa06e0846" returned: 0 in 0.523s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a513dab4-dcf0-4f33-ad57-5ee8f3802a8e tempest-VolumeDependencyTests-965510731 None] Lock "cinder-quobyte-e088368e-8a94-4761-a9ee-474fa06e0846" released by "delete_volume" :: held 1.349s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:49 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-a513dab4-dcf0-4f33-ad57-5ee8f3802a8e tempest-VolumeDependencyTests-965510731 None] Created reservations ['086256ae-6faa-4620-8a95-0238f4497479', '792224c0-2866-4c78-9215-1fad8584d720', '140b1e88-3617-49b5-a690-cfab940ca4a8', '44e0b8b2-a489-43b1-9517-927a92e003d6'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a513dab4-dcf0-4f33-ad57-5ee8f3802a8e tempest-VolumeDependencyTests-965510731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a513dab4-dcf0-4f33-ad57-5ee8f3802a8e tempest-VolumeDependencyTests-965510731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:49 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a513dab4-dcf0-4f33-ad57-5ee8f3802a8e tempest-VolumeDependencyTests-965510731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:49 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a513dab4-dcf0-4f33-ad57-5ee8f3802a8e tempest-VolumeDependencyTests-965510731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a513dab4-dcf0-4f33-ad57-5ee8f3802a8e tempest-VolumeDependencyTests-965510731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a513dab4-dcf0-4f33-ad57-5ee8f3802a8e tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:49 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:54:49 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:49 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a513dab4-dcf0-4f33-ad57-5ee8f3802a8e tempest-VolumeDependencyTests-965510731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.393s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:49 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-a513dab4-dcf0-4f33-ad57-5ee8f3802a8e tempest-VolumeDependencyTests-965510731 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:54:49 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-a513dab4-dcf0-4f33-ad57-5ee8f3802a8e tempest-VolumeDependencyTests-965510731 None] Deleted volume successfully. Nov 05 03:54:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a513dab4-dcf0-4f33-ad57-5ee8f3802a8e tempest-VolumeDependencyTests-965510731 None] Lock "cinder-e088368e-8a94-4761-a9ee-474fa06e0846-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b2b8641a-a9a4-461d-99af-3030b6dc9db3 tempest-VolumeDependencyTests-965510731 None] Acquiring lock "cinder-624d1818-3160-4f22-8aa1-fb661124d3d6-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b2b8641a-a9a4-461d-99af-3030b6dc9db3 tempest-VolumeDependencyTests-965510731 None] Lock "cinder-624d1818-3160-4f22-8aa1-fb661124d3d6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b2b8641a-a9a4-461d-99af-3030b6dc9db3 tempest-VolumeDependencyTests-965510731 None] Acquiring lock "cinder-quobyte-624d1818-3160-4f22-8aa1-fb661124d3d6" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:54:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b2b8641a-a9a4-461d-99af-3030b6dc9db3 tempest-VolumeDependencyTests-965510731 None] Lock "cinder-quobyte-624d1818-3160-4f22-8aa1-fb661124d3d6" acquired by "delete_volume" :: waited 0.032s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:54:50 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d3bf69-2195-4840-8854-c6dbcdd1e52f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b2b8641a-a9a4-461d-99af-3030b6dc9db3 tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-624d1818-3160-4f22-8aa1-fb661124d3d6 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:50 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-624d1818-3160-4f22-8aa1-fb661124d3d6 Nov 05 03:54:50 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:51 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b2b8641a-a9a4-461d-99af-3030b6dc9db3 tempest-VolumeDependencyTests-965510731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-624d1818-3160-4f22-8aa1-fb661124d3d6" returned: 0 in 0.921s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b2b8641a-a9a4-461d-99af-3030b6dc9db3 tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-624d1818-3160-4f22-8aa1-fb661124d3d6 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:51 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-624d1818-3160-4f22-8aa1-fb661124d3d6 Nov 05 03:54:51 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:51 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b2b8641a-a9a4-461d-99af-3030b6dc9db3 tempest-VolumeDependencyTests-965510731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-624d1818-3160-4f22-8aa1-fb661124d3d6" returned: 0 in 0.515s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b2b8641a-a9a4-461d-99af-3030b6dc9db3 tempest-VolumeDependencyTests-965510731 None] Lock "cinder-quobyte-624d1818-3160-4f22-8aa1-fb661124d3d6" released by "delete_volume" :: held 1.557s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:52 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-b2b8641a-a9a4-461d-99af-3030b6dc9db3 tempest-VolumeDependencyTests-965510731 None] Created reservations ['b029621a-aa2f-4a93-a836-353be1d03bfb', 'ff630f17-4e80-445d-a5b2-953ad8363f8a', '5316b238-9bcc-4c85-86c4-6eed1eb55d6f', '9ed14f05-2116-48f6-8b02-56329d72d97c'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:54:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b2b8641a-a9a4-461d-99af-3030b6dc9db3 tempest-VolumeDependencyTests-965510731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b2b8641a-a9a4-461d-99af-3030b6dc9db3 tempest-VolumeDependencyTests-965510731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b2b8641a-a9a4-461d-99af-3030b6dc9db3 tempest-VolumeDependencyTests-965510731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b2b8641a-a9a4-461d-99af-3030b6dc9db3 tempest-VolumeDependencyTests-965510731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b2b8641a-a9a4-461d-99af-3030b6dc9db3 tempest-VolumeDependencyTests-965510731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b2b8641a-a9a4-461d-99af-3030b6dc9db3 tempest-VolumeDependencyTests-965510731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:52 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:54:52 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:52 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b2b8641a-a9a4-461d-99af-3030b6dc9db3 tempest-VolumeDependencyTests-965510731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.516s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:52 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-b2b8641a-a9a4-461d-99af-3030b6dc9db3 tempest-VolumeDependencyTests-965510731 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:54:52 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b2b8641a-a9a4-461d-99af-3030b6dc9db3 tempest-VolumeDependencyTests-965510731 None] Deleted volume successfully. Nov 05 03:54:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b2b8641a-a9a4-461d-99af-3030b6dc9db3 tempest-VolumeDependencyTests-965510731 None] Lock "cinder-624d1818-3160-4f22-8aa1-fb661124d3d6-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:54:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ae412c79-4a30-4c7b-81ef-ddcfae9c9497 tempest-VolumesActionsTest-1065425865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d /opt/stack/data/cinder/conversion/eee363d1-29ef-4945-9286-622c3d26869d.temp_image.b97ce13c-8c86-4042-a860-5ba2be4d336c3q8yy2lh.img" returned: 0 in 8.451s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:55 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f41bf29-501f-4c73-a867-c8c35de70eab]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:54:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ae412c79-4a30-4c7b-81ef-ddcfae9c9497 tempest-VolumesActionsTest-1065425865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:55 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d Nov 05 03:54:55 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:56 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ae412c79-4a30-4c7b-81ef-ddcfae9c9497 tempest-VolumesActionsTest-1065425865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d" returned: 0 in 0.649s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:56 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-ae412c79-4a30-4c7b-81ef-ddcfae9c9497 tempest-VolumesActionsTest-1065425865 None] Image conversion details: src /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d, size 1024.00 MB, duration 8.45 sec, destination /opt/stack/data/cinder/conversion/eee363d1-29ef-4945-9286-622c3d26869d.temp_image.b97ce13c-8c86-4042-a860-5ba2be4d336c3q8yy2lh.img {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:54:56 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-ae412c79-4a30-4c7b-81ef-ddcfae9c9497 tempest-VolumesActionsTest-1065425865 None] Converted 1024.00 MB image at 121.15 MB/s Nov 05 03:54:56 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-ae412c79-4a30-4c7b-81ef-ddcfae9c9497 tempest-VolumesActionsTest-1065425865 None] b97ce13c-8c86-4042-a860-5ba2be4d336c was raw, no need to convert to raw {{(pid=87109) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Nov 05 03:54:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:54:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:54:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:54:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:54:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:54:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:54:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:54:58 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:54:58 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:54:58 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Nov 05 03:54:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.323s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:54:58 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:54:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:54:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 28 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:54:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:55:02 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=26,cinder:INSERT=6,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:55:04 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:55:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Flow 'volume_create_manager' (bc3e526c-9eee-47f4-a848-3e90641074f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4be9c4-9de6-49d2-a9f3-9d2f9d0c7929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd4be9c4-9de6-49d2-a9f3-9d2f9d0c7929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1344586341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6841101637ea46908ad00a6aacf9c71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:04Z,use_quota=True,user_id='bdfc2d9ca50a445a9f8d62468e2a0d1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e412f6f-0b44-4a18-820d-53565fcb0533),volume_type_id=5e412f6f-0b44-4a18-820d-53565fcb0533)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b54791-42eb-4cca-9120-088d71d37c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b54791-42eb-4cca-9120-088d71d37c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1477526c-c458-4155-a22e-78c69a930f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1477526c-c458-4155-a22e-78c69a930f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a', 'volume_name': 'volume-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abbbfd0-2029-4343-a324-8ab1a0b7fa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abbbfd0-2029-4343-a324-8ab1a0b7fa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdea09a3-f82b-4928-9018-47a8e2dafb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:04 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Volume f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a', 'volume_size': 1} Nov 05 03:55:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:04 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:55:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Flow 'volume_create_manager' (f117885d-9320-4e48-a4b7-16d722ad18be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16061d00-a40c-48f6-b2f1-8acee663999c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16061d00-a40c-48f6-b2f1-8acee663999c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1404289617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27587756-e2e9-43b3-9a50-8b5d9c52360d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6841101637ea46908ad00a6aacf9c71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:05Z,use_quota=True,user_id='bdfc2d9ca50a445a9f8d62468e2a0d1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fec6975-79b0-4f58-a94f-cdddc974a51e),volume_type_id=9fec6975-79b0-4f58-a94f-cdddc974a51e)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49c3379-039d-474d-895f-e07d79b93ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49c3379-039d-474d-895f-e07d79b93ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d433b63a-ee17-4ffa-9d2b-81bcc0dfbf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d433b63a-ee17-4ffa-9d2b-81bcc0dfbf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27587756-e2e9-43b3-9a50-8b5d9c52360d', 'volume_name': 'volume-27587756-e2e9-43b3-9a50-8b5d9c52360d', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70cbbaa-4e20-4096-b1c1-33c0848756ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b70cbbaa-4e20-4096-b1c1-33c0848756ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0920e5-b66f-4eb3-80fe-71a58fce0790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:05 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Volume 27587756-e2e9-43b3-9a50-8b5d9c52360d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27587756-e2e9-43b3-9a50-8b5d9c52360d', 'volume_size': 1} Nov 05 03:55:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:05 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:55:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Flow 'volume_create_manager' (6fea3248-c12e-4d83-99fd-2d5ea50fc9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5906d272-143d-477f-98d0-2e3b27988595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5906d272-143d-477f-98d0-2e3b27988595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-151358431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c37b9a41-a351-4933-a8b4-e353b2976d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6841101637ea46908ad00a6aacf9c71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:06Z,use_quota=True,user_id='bdfc2d9ca50a445a9f8d62468e2a0d1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(573047a5-a1d7-4a9e-b33f-949681fd0763),volume_type_id=573047a5-a1d7-4a9e-b33f-949681fd0763)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c25eee-bc44-4968-8423-5ce9f24e66a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c25eee-bc44-4968-8423-5ce9f24e66a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7114f5e-0a7c-4811-926a-69b5cf9c5f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:05 devstack cinder-volume[87109]: DEBUG cinder.image.glance [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Creating Keystone auth plugin from conf {{(pid=87109) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 03:55:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7114f5e-0a7c-4811-926a-69b5cf9c5f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c37b9a41-a351-4933-a8b4-e353b2976d98', 'volume_name': 'volume-c37b9a41-a351-4933-a8b4-e353b2976d98', 'volume_size': 1, 'image_id': '66444fda-839b-476c-9035-3dbc5ed51261', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66444fda-839b-476c-9035-3dbc5ed51261', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1999727313', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6841101637ea46908ad00a6aacf9c71e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '66444fda-839b-476c-9035-3dbc5ed51261', 'created_at': datetime.datetime(2026, 11, 5, 2, 55, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 55, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66444fda-839b-476c-9035-3dbc5ed51261/file', 'properties': {}}, 'image_service': }' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad493358-abe5-4851-832e-b705ea88c08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad493358-abe5-4851-832e-b705ea88c08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:06 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ceb2f9-6ee1-4a99-b884-15dffc28d68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:06 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Volume c37b9a41-a351-4933-a8b4-e353b2976d98: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c37b9a41-a351-4933-a8b4-e353b2976d98', 'volume_size': 1, 'image_id': '66444fda-839b-476c-9035-3dbc5ed51261', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66444fda-839b-476c-9035-3dbc5ed51261', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1999727313', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6841101637ea46908ad00a6aacf9c71e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '66444fda-839b-476c-9035-3dbc5ed51261', 'created_at': datetime.datetime(2026, 11, 5, 2, 55, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 55, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66444fda-839b-476c-9035-3dbc5ed51261/file', 'properties': {}}, 'image_service': } Nov 05 03:55:06 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Trying to clone c37b9a41-a351-4933-a8b4-e353b2976d98 from image 66444fda-839b-476c-9035-3dbc5ed51261 at location (None, [{'url': 'file:///opt/stack/data/glance/images/66444fda-839b-476c-9035-3dbc5ed51261', 'metadata': {}}]). {{(pid=87109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 03:55:10 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_66444fda-839b-476c-9035-3dbc5ed51261_w5t4gol_devstack@QuobyteHD, size 20.69 MB, duration 4.69 sec {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 05 03:55:10 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Image download 20.69 MB at 4.41 MB/s Nov 05 03:55:10 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f49202c-5fad-426c-a8a0-5a46198f209b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_66444fda-839b-476c-9035-3dbc5ed51261_w5t4gol_devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:10 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_66444fda-839b-476c-9035-3dbc5ed51261_w5t4gol_devstack@QuobyteHD Nov 05 03:55:10 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:11 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_66444fda-839b-476c-9035-3dbc5ed51261_w5t4gol_devstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:11 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Temporary image 66444fda-839b-476c-9035-3dbc5ed51261 is fetched for user bdfc2d9ca50a445a9f8d62468e2a0d1b. {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 05 03:55:11 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b03d9d9-952f-4616-aba7-b9ea592082ff]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_66444fda-839b-476c-9035-3dbc5ed51261_w5t4gol_devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:11 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_66444fda-839b-476c-9035-3dbc5ed51261_w5t4gol_devstack@QuobyteHD Nov 05 03:55:11 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:11 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_66444fda-839b-476c-9035-3dbc5ed51261_w5t4gol_devstack@QuobyteHD" returned: 0 in 0.436s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:12 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:55:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Flow 'volume_create_manager' (e8562bff-7ddb-4c52-a312-1541dfe7878f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04fd4f46-1772-48c2-afdf-004c4ff0a048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04fd4f46-1772-48c2-afdf-004c4ff0a048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2020329611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed14cf5-4d82-4abc-b4a2-b4cd86d46104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b29f18db9284c1c8a4a75589f4a17b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:13Z,use_quota=True,user_id='2cbd5db3cf464a99b950bc9142747eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036c70c2-d2f7-48cf-a906-edb93059592e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036c70c2-d2f7-48cf-a906-edb93059592e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8708e1b9-dc5a-4060-910d-a61ec3fc2b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8708e1b9-dc5a-4060-910d-a61ec3fc2b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ed14cf5-4d82-4abc-b4a2-b4cd86d46104', 'volume_name': 'volume-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a699210-75bd-45fc-9bde-0027016fd19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a699210-75bd-45fc-9bde-0027016fd19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a916d005-b5a4-48a8-bef0-75ade25cab37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:13 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Volume 5ed14cf5-4d82-4abc-b4a2-b4cd86d46104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104', 'volume_size': 1} Nov 05 03:55:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ae412c79-4a30-4c7b-81ef-ddcfae9c9497 tempest-VolumesActionsTest-1065425865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.307s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ae412c79-4a30-4c7b-81ef-ddcfae9c9497 tempest-VolumesActionsTest-1065425865 None] Uploaded volume to glance image-id: b97ce13c-8c86-4042-a860-5ba2be4d336c. {{(pid=87109) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1786}} Nov 05 03:55:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.111s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1344586341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6841101637ea46908ad00a6aacf9c71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:04Z,use_quota=True,user_id='bdfc2d9ca50a445a9f8d62468e2a0d1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e412f6f-0b44-4a18-820d-53565fcb0533),volume_type_id=5e412f6f-0b44-4a18-820d-53565fcb0533)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:55:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Creating volume f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:55:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:55:19 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:55:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:19 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a 1073741824 Nov 05 03:55:19 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:19 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-ae412c79-4a30-4c7b-81ef-ddcfae9c9497 tempest-VolumesActionsTest-1065425865 None] Copy volume to image completed successfully. Nov 05 03:55:20 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a 1073741824" returned: 0 in 0.457s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:20 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a Nov 05 03:55:20 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:20 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a" returned: 0 in 0.264s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.307s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1404289617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27587756-e2e9-43b3-9a50-8b5d9c52360d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6841101637ea46908ad00a6aacf9c71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:05Z,use_quota=True,user_id='bdfc2d9ca50a445a9f8d62468e2a0d1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fec6975-79b0-4f58-a94f-cdddc974a51e),volume_type_id=9fec6975-79b0-4f58-a94f-cdddc974a51e)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Creating volume 27587756-e2e9-43b3-9a50-8b5d9c52360d {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:55:20 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-27587756-e2e9-43b3-9a50-8b5d9c52360d 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdea09a3-f82b-4928-9018-47a8e2dafb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:20 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-27587756-e2e9-43b3-9a50-8b5d9c52360d 1073741824 Nov 05 03:55:20 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5533b4-de6c-4d06-b717-3a2611cd63e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:20 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Volume volume-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a (f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a): created successfully Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5533b4-de6c-4d06-b717-3a2611cd63e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Flow 'volume_create_manager' (bc3e526c-9eee-47f4-a848-3e90641074f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:20 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-c9feba4c-2fe1-42af-87b1-fd522e9c20b7 tempest-TestInstancesWithCinderVolumes-831072736 None] Created volume successfully. Nov 05 03:55:20 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-27587756-e2e9-43b3-9a50-8b5d9c52360d 1073741824" returned: 0 in 0.443s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-27587756-e2e9-43b3-9a50-8b5d9c52360d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:20 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-27587756-e2e9-43b3-9a50-8b5d9c52360d Nov 05 03:55:20 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:21 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-27587756-e2e9-43b3-9a50-8b5d9c52360d" returned: 0 in 0.236s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.304s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-151358431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c37b9a41-a351-4933-a8b4-e353b2976d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6841101637ea46908ad00a6aacf9c71e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:06Z,use_quota=True,user_id='bdfc2d9ca50a445a9f8d62468e2a0d1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(573047a5-a1d7-4a9e-b33f-949681fd0763),volume_type_id=573047a5-a1d7-4a9e-b33f-949681fd0763)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Creating volume c37b9a41-a351-4933-a8b4-e353b2976d98 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:55:21 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c37b9a41-a351-4933-a8b4-e353b2976d98 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0920e5-b66f-4eb3-80fe-71a58fce0790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27587756-e2e9-43b3-9a50-8b5d9c52360d', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:21 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c37b9a41-a351-4933-a8b4-e353b2976d98 1073741824 Nov 05 03:55:21 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22671b9d-54bd-4666-9e60-124003284260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:21 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Volume volume-27587756-e2e9-43b3-9a50-8b5d9c52360d (27587756-e2e9-43b3-9a50-8b5d9c52360d): created successfully Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22671b9d-54bd-4666-9e60-124003284260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Flow 'volume_create_manager' (f117885d-9320-4e48-a4b7-16d722ad18be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:21 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-550a1e5e-46d0-4c70-8e09-5da71658984b tempest-TestInstancesWithCinderVolumes-831072736 None] Created volume successfully. Nov 05 03:55:21 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c37b9a41-a351-4933-a8b4-e353b2976d98 1073741824" returned: 0 in 0.405s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c37b9a41-a351-4933-a8b4-e353b2976d98 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:21 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c37b9a41-a351-4933-a8b4-e353b2976d98 Nov 05 03:55:21 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:21 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c37b9a41-a351-4933-a8b4-e353b2976d98" returned: 0 in 0.229s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.692s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2020329611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed14cf5-4d82-4abc-b4a2-b4cd86d46104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b29f18db9284c1c8a4a75589f4a17b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:13Z,use_quota=True,user_id='2cbd5db3cf464a99b950bc9142747eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Creating volume 5ed14cf5-4d82-4abc-b4a2-b4cd86d46104 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:55:21 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:21 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104 1073741824 Nov 05 03:55:21 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Attempting download of 66444fda-839b-476c-9035-3dbc5ed51261 ((None, [{'url': 'file:///opt/stack/data/glance/images/66444fda-839b-476c-9035-3dbc5ed51261', 'metadata': {}}])) to volume c37b9a41-a351-4933-a8b4-e353b2976d98. {{(pid=87109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[876a3cee-1218-493e-ae49-a6ecc111b8b9]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66444fda-839b-476c-9035-3dbc5ed51261_5quemtir {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:21 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66444fda-839b-476c-9035-3dbc5ed51261_5quemtir Nov 05 03:55:21 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:22 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104 1073741824" returned: 0 in 0.411s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:22 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66444fda-839b-476c-9035-3dbc5ed51261_5quemtir" returned: 0 in 0.349s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66444fda-839b-476c-9035-3dbc5ed51261_5quemtir {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:22 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104 Nov 05 03:55:22 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:22 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66444fda-839b-476c-9035-3dbc5ed51261_5quemtir Nov 05 03:55:22 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:22 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104" returned: 0 in 0.263s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.619s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a916d005-b5a4-48a8-bef0-75ade25cab37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67977040-9d4e-44e6-b08c-66ab0cc58546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[587755bf-93bb-4f85-8a05-d8d5bfce825f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:22 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66444fda-839b-476c-9035-3dbc5ed51261_5quemtir" returned: 1 in 0.340s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66444fda-839b-476c-9035-3dbc5ed51261_5quemtir' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e02c0e-2db3-4ea5-857a-e3411d03e0f7]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_66444fda-839b-476c-9035-3dbc5ed51261_w5t4gol_devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:22 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Volume volume-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104 (5ed14cf5-4d82-4abc-b4a2-b4cd86d46104): created successfully Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67977040-9d4e-44e6-b08c-66ab0cc58546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Flow 'volume_create_manager' (e8562bff-7ddb-4c52-a312-1541dfe7878f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:22 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-e990ad0e-c32d-4f15-83d9-7c815e9e8871 tempest-ProjectReaderTests-1701832032 None] Created volume successfully. Nov 05 03:55:22 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d Nov 05 03:55:22 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:22 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_66444fda-839b-476c-9035-3dbc5ed51261_w5t4gol_devstack@QuobyteHD Nov 05 03:55:22 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:22 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:22 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_66444fda-839b-476c-9035-3dbc5ed51261_w5t4gol_devstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] 66444fda-839b-476c-9035-3dbc5ed51261 was qcow2, converting to qcow2 {{(pid=87109) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_66444fda-839b-476c-9035-3dbc5ed51261_w5t4gol_devstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c37b9a41-a351-4933-a8b4-e353b2976d98 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d" returned: 0 in 0.399s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:22 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_66444fda-839b-476c-9035-3dbc5ed51261_w5t4gol_devstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c37b9a41-a351-4933-a8b4-e353b2976d98 Nov 05 03:55:22 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33647dc-95dc-479c-8747-208002623dd6]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:23 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d Nov 05 03:55:23 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:23 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d" returned: 0 in 0.398s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d /opt/stack/data/cinder/conversion/eee363d1-29ef-4945-9286-622c3d26869d.temp_image.78cb8d89-a88b-4bf2-bb85-78ef04384255km0hwnr4.img {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:23 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d /opt/stack/data/cinder/conversion/eee363d1-29ef-4945-9286-622c3d26869d.temp_image.78cb8d89-a88b-4bf2-bb85-78ef04384255km0hwnr4.img Nov 05 03:55:23 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-912b1fec-6fbb-495f-b9af-927a527789c1 tempest-ProjectReaderTests-1701832032 None] Acquiring lock "cinder-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-912b1fec-6fbb-495f-b9af-927a527789c1 tempest-ProjectReaderTests-1701832032 None] Lock "cinder-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-912b1fec-6fbb-495f-b9af-927a527789c1 tempest-ProjectReaderTests-1701832032 None] Acquiring lock "cinder-quobyte-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-912b1fec-6fbb-495f-b9af-927a527789c1 tempest-ProjectReaderTests-1701832032 None] Lock "cinder-quobyte-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104" acquired by "delete_volume" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:24 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7673d042-c70a-4afc-885b-4c031e20334a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-912b1fec-6fbb-495f-b9af-927a527789c1 tempest-ProjectReaderTests-1701832032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:24 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104 Nov 05 03:55:24 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:25 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-912b1fec-6fbb-495f-b9af-927a527789c1 tempest-ProjectReaderTests-1701832032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104" returned: 0 in 1.013s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-912b1fec-6fbb-495f-b9af-927a527789c1 tempest-ProjectReaderTests-1701832032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:25 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104 Nov 05 03:55:25 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:25 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-912b1fec-6fbb-495f-b9af-927a527789c1 tempest-ProjectReaderTests-1701832032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104" returned: 0 in 0.457s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-912b1fec-6fbb-495f-b9af-927a527789c1 tempest-ProjectReaderTests-1701832032 None] Lock "cinder-quobyte-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104" released by "delete_volume" :: held 1.563s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:26 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-912b1fec-6fbb-495f-b9af-927a527789c1 tempest-ProjectReaderTests-1701832032 None] Created reservations ['7856f724-a888-4824-b74f-dc555f829682', '4d722070-dab0-4ff1-92fa-9bd9443e66b3', '05fbe47b-a00d-47b4-bbd6-fd0c62a2bf4b', '74bf79bf-9203-4414-9620-741d12896440'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:55:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-912b1fec-6fbb-495f-b9af-927a527789c1 tempest-ProjectReaderTests-1701832032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-912b1fec-6fbb-495f-b9af-927a527789c1 tempest-ProjectReaderTests-1701832032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-912b1fec-6fbb-495f-b9af-927a527789c1 tempest-ProjectReaderTests-1701832032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-912b1fec-6fbb-495f-b9af-927a527789c1 tempest-ProjectReaderTests-1701832032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-912b1fec-6fbb-495f-b9af-927a527789c1 tempest-ProjectReaderTests-1701832032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-912b1fec-6fbb-495f-b9af-927a527789c1 tempest-ProjectReaderTests-1701832032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:26 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:55:26 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:26 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-912b1fec-6fbb-495f-b9af-927a527789c1 tempest-ProjectReaderTests-1701832032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.318s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:26 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-912b1fec-6fbb-495f-b9af-927a527789c1 tempest-ProjectReaderTests-1701832032 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:55:26 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-912b1fec-6fbb-495f-b9af-927a527789c1 tempest-ProjectReaderTests-1701832032 None] Deleted volume successfully. Nov 05 03:55:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-912b1fec-6fbb-495f-b9af-927a527789c1 tempest-ProjectReaderTests-1701832032 None] Lock "cinder-5ed14cf5-4d82-4abc-b4a2-b4cd86d46104-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:27 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_66444fda-839b-476c-9035-3dbc5ed51261_w5t4gol_devstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c37b9a41-a351-4933-a8b4-e353b2976d98" returned: 0 in 4.482s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:27 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_66444fda-839b-476c-9035-3dbc5ed51261_w5t4gol_devstack@QuobyteHD, size 112.00 MB, duration 4.48 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c37b9a41-a351-4933-a8b4-e353b2976d98 {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:55:27 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Converted 112.00 MB image at 24.99 MB/s Nov 05 03:55:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c37b9a41-a351-4933-a8b4-e353b2976d98 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:27 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c37b9a41-a351-4933-a8b4-e353b2976d98 1G Nov 05 03:55:27 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:27 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:55:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Flow 'volume_create_manager' (ad88ae6a-cdf9-490b-8820-db94f90ce6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd15a8c-44a0-4fb2-9594-7f6b7bf0515c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd15a8c-44a0-4fb2-9594-7f6b7bf0515c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-927857256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35cde8a7-3366-4752-ae7e-19f04408f56a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b29f18db9284c1c8a4a75589f4a17b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:28Z,use_quota=True,user_id='2cbd5db3cf464a99b950bc9142747eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4fdf56-e763-4140-99b5-9ea5baeec960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4fdf56-e763-4140-99b5-9ea5baeec960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c1e074-de8a-4c1c-a209-bf0d155a6441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c1e074-de8a-4c1c-a209-bf0d155a6441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35cde8a7-3366-4752-ae7e-19f04408f56a', 'volume_name': 'volume-35cde8a7-3366-4752-ae7e-19f04408f56a', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73db1a71-9324-45ec-95e4-0ee479fb5b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73db1a71-9324-45ec-95e4-0ee479fb5b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:27 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b912c183-2e65-4ba6-a1bc-3c26b94fd592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:27 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Volume 35cde8a7-3366-4752-ae7e-19f04408f56a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35cde8a7-3366-4752-ae7e-19f04408f56a', 'volume_size': 1} Nov 05 03:55:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:28 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c37b9a41-a351-4933-a8b4-e353b2976d98 1G" returned: 0 in 0.721s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:28 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Downloaded image 66444fda-839b-476c-9035-3dbc5ed51261 ((None, [{'url': 'file:///opt/stack/data/glance/images/66444fda-839b-476c-9035-3dbc5ed51261', 'metadata': {}}])) to volume c37b9a41-a351-4933-a8b4-e353b2976d98 successfully. {{(pid=87109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 05 03:55:28 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Temporary image 66444fda-839b-476c-9035-3dbc5ed51261 for user bdfc2d9ca50a445a9f8d62468e2a0d1b is deleted. {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 05 03:55:28 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Marking volume c37b9a41-a351-4933-a8b4-e353b2976d98 as bootable. {{(pid=87109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 05 03:55:28 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Copying metadata from image 66444fda-839b-476c-9035-3dbc5ed51261 to c37b9a41-a351-4933-a8b4-e353b2976d98. {{(pid=87109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 03:55:28 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Creating volume glance metadata for volume c37b9a41-a351-4933-a8b4-e353b2976d98 backed by image 66444fda-839b-476c-9035-3dbc5ed51261 with: {'image_id': '66444fda-839b-476c-9035-3dbc5ed51261', 'image_name': 'tempest-scenario-img--1999727313', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 03:55:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ceb2f9-6ee1-4a99-b884-15dffc28d68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c37b9a41-a351-4933-a8b4-e353b2976d98', 'volume_size': 1, 'image_id': '66444fda-839b-476c-9035-3dbc5ed51261', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66444fda-839b-476c-9035-3dbc5ed51261', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1999727313', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6841101637ea46908ad00a6aacf9c71e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '66444fda-839b-476c-9035-3dbc5ed51261', 'created_at': datetime.datetime(2026, 11, 5, 2, 55, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 55, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66444fda-839b-476c-9035-3dbc5ed51261/file', 'properties': {}}, 'image_service': }' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a53bc7-5702-4cd5-a2d6-d608b4dd3688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:28 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Volume volume-c37b9a41-a351-4933-a8b4-e353b2976d98 (c37b9a41-a351-4933-a8b4-e353b2976d98): created successfully Nov 05 03:55:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a53bc7-5702-4cd5-a2d6-d608b4dd3688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Flow 'volume_create_manager' (6fea3248-c12e-4d83-99fd-2d5ea50fc9e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:28 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b33bdca3-ac2e-4386-be4e-f0a246a25b88 tempest-TestInstancesWithCinderVolumes-831072736 None] Created volume successfully. Nov 05 03:55:30 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d /opt/stack/data/cinder/conversion/eee363d1-29ef-4945-9286-622c3d26869d.temp_image.78cb8d89-a88b-4bf2-bb85-78ef04384255km0hwnr4.img" returned: 0 in 7.332s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:30 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b23d59-c38c-4c67-9093-53c6f6483d44]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:30 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d Nov 05 03:55:30 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:31 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d" returned: 0 in 0.558s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:31 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] Image conversion details: src /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d, size 1024.00 MB, duration 7.33 sec, destination /opt/stack/data/cinder/conversion/eee363d1-29ef-4945-9286-622c3d26869d.temp_image.78cb8d89-a88b-4bf2-bb85-78ef04384255km0hwnr4.img {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:55:31 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] Converted 1024.00 MB image at 139.65 MB/s Nov 05 03:55:31 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] 78cb8d89-a88b-4bf2-bb85-78ef04384255 was raw, converting to qcow2 {{(pid=87109) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Nov 05 03:55:31 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[087a2724-e01a-4fc6-adc3-da1e18e233d1]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eee363d1-29ef-4945-9286-622c3d26869d.temp_image.78cb8d89-a88b-4bf2-bb85-78ef04384255km0hwnr4.img {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:31 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eee363d1-29ef-4945-9286-622c3d26869d.temp_image.78cb8d89-a88b-4bf2-bb85-78ef04384255km0hwnr4.img Nov 05 03:55:31 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:31 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eee363d1-29ef-4945-9286-622c3d26869d.temp_image.78cb8d89-a88b-4bf2-bb85-78ef04384255km0hwnr4.img" returned: 0 in 0.343s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eee363d1-29ef-4945-9286-622c3d26869d.temp_image.78cb8d89-a88b-4bf2-bb85-78ef04384255km0hwnr4.img {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:31 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eee363d1-29ef-4945-9286-622c3d26869d.temp_image.78cb8d89-a88b-4bf2-bb85-78ef04384255km0hwnr4.img Nov 05 03:55:31 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:31 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eee363d1-29ef-4945-9286-622c3d26869d.temp_image.78cb8d89-a88b-4bf2-bb85-78ef04384255km0hwnr4.img" returned: 1 in 0.330s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eee363d1-29ef-4945-9286-622c3d26869d.temp_image.78cb8d89-a88b-4bf2-bb85-78ef04384255km0hwnr4.img' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:55:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eee363d1-29ef-4945-9286-622c3d26869d.temp_image.78cb8d89-a88b-4bf2-bb85-78ef04384255km0hwnr4.img /opt/stack/data/cinder/conversion/vol_upload_ftr2ovux {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:31 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eee363d1-29ef-4945-9286-622c3d26869d.temp_image.78cb8d89-a88b-4bf2-bb85-78ef04384255km0hwnr4.img /opt/stack/data/cinder/conversion/vol_upload_ftr2ovux Nov 05 03:55:31 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:32 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eee363d1-29ef-4945-9286-622c3d26869d.temp_image.78cb8d89-a88b-4bf2-bb85-78ef04384255km0hwnr4.img /opt/stack/data/cinder/conversion/vol_upload_ftr2ovux" returned: 0 in 0.337s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:32 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] Image conversion details: src /opt/stack/data/cinder/conversion/eee363d1-29ef-4945-9286-622c3d26869d.temp_image.78cb8d89-a88b-4bf2-bb85-78ef04384255km0hwnr4.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ftr2ovux {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:55:32 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 05 03:55:32 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4ae826-8994-42ed-ba56-7750e22a50c6]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ftr2ovux {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:32 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ftr2ovux Nov 05 03:55:32 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:32 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=53,cinder:UPDATE=52,cinder:INSERT=15,cinder:DELETE=3 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:55:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-ab7a501e-6f3f-4121-b726-abaaff44b5b1 req-8d44fe39-531f-4e8e-b0a6-3c2c9e95abd9 tempest-TestInstancesWithCinderVolumes-831072736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:32 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ftr2ovux" returned: 0 in 0.365s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.742s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] Uploaded volume to glance image-id: 78cb8d89-a88b-4bf2-bb85-78ef04384255. {{(pid=87109) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1786}} Nov 05 03:55:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.260s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-927857256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35cde8a7-3366-4752-ae7e-19f04408f56a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b29f18db9284c1c8a4a75589f4a17b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:28Z,use_quota=True,user_id='2cbd5db3cf464a99b950bc9142747eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:55:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Creating volume 35cde8a7-3366-4752-ae7e-19f04408f56a {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:55:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:55:34 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:55:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-35cde8a7-3366-4752-ae7e-19f04408f56a 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:34 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-35cde8a7-3366-4752-ae7e-19f04408f56a 1073741824 Nov 05 03:55:34 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:34 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-7662aa75-b9cc-4c7f-aa6e-86904149563e tempest-VolumesActionsTest-1065425865 None] Copy volume to image completed successfully. Nov 05 03:55:34 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-35cde8a7-3366-4752-ae7e-19f04408f56a 1073741824" returned: 0 in 0.580s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-35cde8a7-3366-4752-ae7e-19f04408f56a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:34 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-35cde8a7-3366-4752-ae7e-19f04408f56a Nov 05 03:55:34 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:35 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-35cde8a7-3366-4752-ae7e-19f04408f56a" returned: 0 in 0.267s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-ab7a501e-6f3f-4121-b726-abaaff44b5b1 req-8d44fe39-531f-4e8e-b0a6-3c2c9e95abd9 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.567s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-ab7a501e-6f3f-4121-b726-abaaff44b5b1 req-8d44fe39-531f-4e8e-b0a6-3c2c9e95abd9 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b912c183-2e65-4ba6-a1bc-3c26b94fd592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35cde8a7-3366-4752-ae7e-19f04408f56a', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ff759f-2e63-440f-907d-1223b2de027c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:35 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Volume volume-35cde8a7-3366-4752-ae7e-19f04408f56a (35cde8a7-3366-4752-ae7e-19f04408f56a): created successfully Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ff759f-2e63-440f-907d-1223b2de027c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Flow 'volume_create_manager' (ad88ae6a-cdf9-490b-8820-db94f90ce6ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:35 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-95ce14b5-8f07-4063-af51-096b16a154b8 tempest-ProjectReaderTests-1701832032 None] Created volume successfully. Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-ab7a501e-6f3f-4121-b726-abaaff44b5b1 req-8d44fe39-531f-4e8e-b0a6-3c2c9e95abd9 tempest-TestInstancesWithCinderVolumes-831072736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-c37b9a41-a351-4933-a8b4-e353b2976d98', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4f8788c-d69a-4396-b9a8-be191b0aac78', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:55:35 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-ab7a501e-6f3f-4121-b726-abaaff44b5b1 req-8d44fe39-531f-4e8e-b0a6-3c2c9e95abd9 tempest-TestInstancesWithCinderVolumes-831072736 None] attachment_update completed successfully. Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-747cd904-24db-439f-9b80-068688566ddb tempest-VolumesActionsTest-1065425865 None] Acquiring lock "cinder-eee363d1-29ef-4945-9286-622c3d26869d-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-747cd904-24db-439f-9b80-068688566ddb tempest-VolumesActionsTest-1065425865 None] Lock "cinder-eee363d1-29ef-4945-9286-622c3d26869d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-747cd904-24db-439f-9b80-068688566ddb tempest-VolumesActionsTest-1065425865 None] Acquiring lock "cinder-quobyte-eee363d1-29ef-4945-9286-622c3d26869d" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-747cd904-24db-439f-9b80-068688566ddb tempest-VolumesActionsTest-1065425865 None] Lock "cinder-quobyte-eee363d1-29ef-4945-9286-622c3d26869d" acquired by "delete_volume" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e04ad02-7a88-470c-a572-d0c9e117ad45]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-747cd904-24db-439f-9b80-068688566ddb tempest-VolumesActionsTest-1065425865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-34a4e219-101f-465a-970a-7fc5b8ef5897 tempest-ProjectReaderTests-1701832032 None] Acquiring lock "cinder-35cde8a7-3366-4752-ae7e-19f04408f56a-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-34a4e219-101f-465a-970a-7fc5b8ef5897 tempest-ProjectReaderTests-1701832032 None] Lock "cinder-35cde8a7-3366-4752-ae7e-19f04408f56a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-34a4e219-101f-465a-970a-7fc5b8ef5897 tempest-ProjectReaderTests-1701832032 None] Acquiring lock "cinder-quobyte-35cde8a7-3366-4752-ae7e-19f04408f56a" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:35 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d Nov 05 03:55:35 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-34a4e219-101f-465a-970a-7fc5b8ef5897 tempest-ProjectReaderTests-1701832032 None] Lock "cinder-quobyte-35cde8a7-3366-4752-ae7e-19f04408f56a" acquired by "delete_volume" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[896dd89c-d818-4daf-bbe4-f32ec98f1985]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-34a4e219-101f-465a-970a-7fc5b8ef5897 tempest-ProjectReaderTests-1701832032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-35cde8a7-3366-4752-ae7e-19f04408f56a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:35 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-35cde8a7-3366-4752-ae7e-19f04408f56a Nov 05 03:55:35 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:35 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-747cd904-24db-439f-9b80-068688566ddb tempest-VolumesActionsTest-1065425865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d" returned: 0 in 0.441s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-747cd904-24db-439f-9b80-068688566ddb tempest-VolumesActionsTest-1065425865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:35 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d Nov 05 03:55:35 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:36 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-34a4e219-101f-465a-970a-7fc5b8ef5897 tempest-ProjectReaderTests-1701832032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-35cde8a7-3366-4752-ae7e-19f04408f56a" returned: 0 in 0.587s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-34a4e219-101f-465a-970a-7fc5b8ef5897 tempest-ProjectReaderTests-1701832032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-35cde8a7-3366-4752-ae7e-19f04408f56a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:36 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-35cde8a7-3366-4752-ae7e-19f04408f56a Nov 05 03:55:36 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:36 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-747cd904-24db-439f-9b80-068688566ddb tempest-VolumesActionsTest-1065425865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eee363d1-29ef-4945-9286-622c3d26869d" returned: 0 in 0.466s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-747cd904-24db-439f-9b80-068688566ddb tempest-VolumesActionsTest-1065425865 None] Lock "cinder-quobyte-eee363d1-29ef-4945-9286-622c3d26869d" released by "delete_volume" :: held 0.980s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:36 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-747cd904-24db-439f-9b80-068688566ddb tempest-VolumesActionsTest-1065425865 None] Created reservations ['975193c0-72b4-4f77-a886-c48e676c5c2d', 'a9005fc6-fdfa-49dc-a3ce-1a30a78ec8a4', '3b62673e-1572-404b-946a-193302e13bfc', '92a07836-736b-4da4-8dc9-4efaaa59fa68'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:55:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-747cd904-24db-439f-9b80-068688566ddb tempest-VolumesActionsTest-1065425865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-747cd904-24db-439f-9b80-068688566ddb tempest-VolumesActionsTest-1065425865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:36 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-747cd904-24db-439f-9b80-068688566ddb tempest-VolumesActionsTest-1065425865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-747cd904-24db-439f-9b80-068688566ddb tempest-VolumesActionsTest-1065425865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-747cd904-24db-439f-9b80-068688566ddb tempest-VolumesActionsTest-1065425865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-747cd904-24db-439f-9b80-068688566ddb tempest-VolumesActionsTest-1065425865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-34a4e219-101f-465a-970a-7fc5b8ef5897 tempest-ProjectReaderTests-1701832032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-35cde8a7-3366-4752-ae7e-19f04408f56a" returned: 0 in 0.526s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:36 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:55:36 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-34a4e219-101f-465a-970a-7fc5b8ef5897 tempest-ProjectReaderTests-1701832032 None] Lock "cinder-quobyte-35cde8a7-3366-4752-ae7e-19f04408f56a" released by "delete_volume" :: held 1.173s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:36 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-34a4e219-101f-465a-970a-7fc5b8ef5897 tempest-ProjectReaderTests-1701832032 None] Created reservations ['48cdb818-f9c4-4543-aabc-134b29ae7285', 'ea2dfb67-bdb9-45db-ac16-6dbf88e7b5e3', '87922516-b329-4954-b9ce-bf1f741bf69f', 'ef90c327-3985-45fc-8a90-6393b347856c'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:55:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-34a4e219-101f-465a-970a-7fc5b8ef5897 tempest-ProjectReaderTests-1701832032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-34a4e219-101f-465a-970a-7fc5b8ef5897 tempest-ProjectReaderTests-1701832032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-34a4e219-101f-465a-970a-7fc5b8ef5897 tempest-ProjectReaderTests-1701832032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-34a4e219-101f-465a-970a-7fc5b8ef5897 tempest-ProjectReaderTests-1701832032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-34a4e219-101f-465a-970a-7fc5b8ef5897 tempest-ProjectReaderTests-1701832032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-34a4e219-101f-465a-970a-7fc5b8ef5897 tempest-ProjectReaderTests-1701832032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:37 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-747cd904-24db-439f-9b80-068688566ddb tempest-VolumesActionsTest-1065425865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.334s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:37 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-747cd904-24db-439f-9b80-068688566ddb tempest-VolumesActionsTest-1065425865 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:55:37 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:55:37 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:37 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-747cd904-24db-439f-9b80-068688566ddb tempest-VolumesActionsTest-1065425865 None] Deleted volume successfully. Nov 05 03:55:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-747cd904-24db-439f-9b80-068688566ddb tempest-VolumesActionsTest-1065425865 None] Lock "cinder-eee363d1-29ef-4945-9286-622c3d26869d-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:37 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-34a4e219-101f-465a-970a-7fc5b8ef5897 tempest-ProjectReaderTests-1701832032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.293s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:37 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-34a4e219-101f-465a-970a-7fc5b8ef5897 tempest-ProjectReaderTests-1701832032 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:55:37 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-34a4e219-101f-465a-970a-7fc5b8ef5897 tempest-ProjectReaderTests-1701832032 None] Deleted volume successfully. Nov 05 03:55:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-34a4e219-101f-465a-970a-7fc5b8ef5897 tempest-ProjectReaderTests-1701832032 None] Lock "cinder-35cde8a7-3366-4752-ae7e-19f04408f56a-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Flow 'volume_create_manager' (91b4b40b-b817-4c13-adb5-3d74834747e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deec8ac4-6d49-499c-9d43-bf4ae5a5b4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deec8ac4-6d49-499c-9d43-bf4ae5a5b4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-696040080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b10602f-2bae-4ff9-aefe-afb14cda8ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b29f18db9284c1c8a4a75589f4a17b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:38Z,use_quota=True,user_id='2cbd5db3cf464a99b950bc9142747eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6abfe33-991b-471e-a413-a08388dc695d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6abfe33-991b-471e-a413-a08388dc695d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b65593-65a7-426f-8696-875a6aa5b3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28b65593-65a7-426f-8696-875a6aa5b3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b10602f-2bae-4ff9-aefe-afb14cda8ac7', 'volume_name': 'volume-7b10602f-2bae-4ff9-aefe-afb14cda8ac7', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50fe737-efb4-4f04-951f-d62a63ff8050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a50fe737-efb4-4f04-951f-d62a63ff8050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ad0343-c8ab-4d30-8241-02166ab0b6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:38 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Volume 7b10602f-2bae-4ff9-aefe-afb14cda8ac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b10602f-2bae-4ff9-aefe-afb14cda8ac7', 'volume_size': 1} Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-696040080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b10602f-2bae-4ff9-aefe-afb14cda8ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b29f18db9284c1c8a4a75589f4a17b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:38Z,use_quota=True,user_id='2cbd5db3cf464a99b950bc9142747eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Creating volume 7b10602f-2bae-4ff9-aefe-afb14cda8ac7 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:55:38 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:55:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b10602f-2bae-4ff9-aefe-afb14cda8ac7 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:38 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b10602f-2bae-4ff9-aefe-afb14cda8ac7 1073741824 Nov 05 03:55:38 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:39 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b10602f-2bae-4ff9-aefe-afb14cda8ac7 1073741824" returned: 0 in 0.619s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b10602f-2bae-4ff9-aefe-afb14cda8ac7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:39 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b10602f-2bae-4ff9-aefe-afb14cda8ac7 Nov 05 03:55:39 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:39 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b10602f-2bae-4ff9-aefe-afb14cda8ac7" returned: 0 in 0.422s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:55:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:39 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ad0343-c8ab-4d30-8241-02166ab0b6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b10602f-2bae-4ff9-aefe-afb14cda8ac7', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:39 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c253bc-c46f-4e12-acd0-59e14a177942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:39 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Volume volume-7b10602f-2bae-4ff9-aefe-afb14cda8ac7 (7b10602f-2bae-4ff9-aefe-afb14cda8ac7): created successfully Nov 05 03:55:39 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c253bc-c46f-4e12-acd0-59e14a177942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:39 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Flow 'volume_create_manager' (91b4b40b-b817-4c13-adb5-3d74834747e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:39 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-0e2e5f86-f943-47a2-8eae-7e08ad1a9d2c tempest-ProjectReaderTests-1701832032 None] Created volume successfully. Nov 05 03:55:40 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9a4d7256-ffc4-429b-b4d6-1f18b4bac842 tempest-ProjectReaderTests-1701832032 None] Acquiring lock "cinder-7b10602f-2bae-4ff9-aefe-afb14cda8ac7-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:40 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9a4d7256-ffc4-429b-b4d6-1f18b4bac842 tempest-ProjectReaderTests-1701832032 None] Lock "cinder-7b10602f-2bae-4ff9-aefe-afb14cda8ac7-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:41 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9a4d7256-ffc4-429b-b4d6-1f18b4bac842 tempest-ProjectReaderTests-1701832032 None] Acquiring lock "cinder-quobyte-7b10602f-2bae-4ff9-aefe-afb14cda8ac7" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:41 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9a4d7256-ffc4-429b-b4d6-1f18b4bac842 tempest-ProjectReaderTests-1701832032 None] Lock "cinder-quobyte-7b10602f-2bae-4ff9-aefe-afb14cda8ac7" acquired by "delete_volume" :: waited 0.033s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:41 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4479eb-dade-4f43-887c-7ca931805e9f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9a4d7256-ffc4-429b-b4d6-1f18b4bac842 tempest-ProjectReaderTests-1701832032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b10602f-2bae-4ff9-aefe-afb14cda8ac7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:41 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b10602f-2bae-4ff9-aefe-afb14cda8ac7 Nov 05 03:55:41 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:41 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9a4d7256-ffc4-429b-b4d6-1f18b4bac842 tempest-ProjectReaderTests-1701832032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b10602f-2bae-4ff9-aefe-afb14cda8ac7" returned: 0 in 0.507s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9a4d7256-ffc4-429b-b4d6-1f18b4bac842 tempest-ProjectReaderTests-1701832032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b10602f-2bae-4ff9-aefe-afb14cda8ac7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:41 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b10602f-2bae-4ff9-aefe-afb14cda8ac7 Nov 05 03:55:41 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:42 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9a4d7256-ffc4-429b-b4d6-1f18b4bac842 tempest-ProjectReaderTests-1701832032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b10602f-2bae-4ff9-aefe-afb14cda8ac7" returned: 0 in 0.444s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:42 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9a4d7256-ffc4-429b-b4d6-1f18b4bac842 tempest-ProjectReaderTests-1701832032 None] Lock "cinder-quobyte-7b10602f-2bae-4ff9-aefe-afb14cda8ac7" released by "delete_volume" :: held 1.041s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:42 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-9a4d7256-ffc4-429b-b4d6-1f18b4bac842 tempest-ProjectReaderTests-1701832032 None] Created reservations ['2eea78df-2178-406e-9d99-3c5df587ca1b', 'bb527ba0-bb5b-4d77-a883-145f34500fb5', '62bb8f72-ec2b-4041-b0df-ccc6b8a0181f', '4d288edd-70a8-47b8-a3ae-71d77fe72eca'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:55:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9a4d7256-ffc4-429b-b4d6-1f18b4bac842 tempest-ProjectReaderTests-1701832032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9a4d7256-ffc4-429b-b4d6-1f18b4bac842 tempest-ProjectReaderTests-1701832032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:42 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9a4d7256-ffc4-429b-b4d6-1f18b4bac842 tempest-ProjectReaderTests-1701832032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:42 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9a4d7256-ffc4-429b-b4d6-1f18b4bac842 tempest-ProjectReaderTests-1701832032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9a4d7256-ffc4-429b-b4d6-1f18b4bac842 tempest-ProjectReaderTests-1701832032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9a4d7256-ffc4-429b-b4d6-1f18b4bac842 tempest-ProjectReaderTests-1701832032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:42 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:55:42 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:42 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9a4d7256-ffc4-429b-b4d6-1f18b4bac842 tempest-ProjectReaderTests-1701832032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.420s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:42 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-9a4d7256-ffc4-429b-b4d6-1f18b4bac842 tempest-ProjectReaderTests-1701832032 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:55:42 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-9a4d7256-ffc4-429b-b4d6-1f18b4bac842 tempest-ProjectReaderTests-1701832032 None] Deleted volume successfully. Nov 05 03:55:42 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9a4d7256-ffc4-429b-b4d6-1f18b4bac842 tempest-ProjectReaderTests-1701832032 None] Lock "cinder-7b10602f-2bae-4ff9-aefe-afb14cda8ac7-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Flow 'volume_create_manager' (821a7b51-4f9e-4aab-a05c-434a4f0b39de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383adbdb-04ed-488d-a9fd-ff866a8bfd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383adbdb-04ed-488d-a9fd-ff866a8bfd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-47927163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99fd45fa-afb8-4490-9338-7b9aedf1be49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b29f18db9284c1c8a4a75589f4a17b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:44Z,use_quota=True,user_id='2cbd5db3cf464a99b950bc9142747eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d833ec01-5ac9-4023-9ebe-54a1909c42ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d833ec01-5ac9-4023-9ebe-54a1909c42ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33daafe2-9f40-4f39-bdbf-dc1a1b6af462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33daafe2-9f40-4f39-bdbf-dc1a1b6af462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99fd45fa-afb8-4490-9338-7b9aedf1be49', 'volume_name': 'volume-99fd45fa-afb8-4490-9338-7b9aedf1be49', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ba1ae0-ae1f-4de0-aa93-2302f7ad73fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ba1ae0-ae1f-4de0-aa93-2302f7ad73fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500df87a-4b6a-4d44-89c9-ed94714b1b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:44 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Volume 99fd45fa-afb8-4490-9338-7b9aedf1be49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99fd45fa-afb8-4490-9338-7b9aedf1be49', 'volume_size': 1} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-47927163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99fd45fa-afb8-4490-9338-7b9aedf1be49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b29f18db9284c1c8a4a75589f4a17b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:44Z,use_quota=True,user_id='2cbd5db3cf464a99b950bc9142747eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Creating volume 99fd45fa-afb8-4490-9338-7b9aedf1be49 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:55:44 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-99fd45fa-afb8-4490-9338-7b9aedf1be49 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:44 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-99fd45fa-afb8-4490-9338-7b9aedf1be49 1073741824 Nov 05 03:55:44 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:44 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-99fd45fa-afb8-4490-9338-7b9aedf1be49 1073741824" returned: 0 in 0.545s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-99fd45fa-afb8-4490-9338-7b9aedf1be49 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:44 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-99fd45fa-afb8-4490-9338-7b9aedf1be49 Nov 05 03:55:44 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:45 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-99fd45fa-afb8-4490-9338-7b9aedf1be49" returned: 0 in 0.404s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:45 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:55:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500df87a-4b6a-4d44-89c9-ed94714b1b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99fd45fa-afb8-4490-9338-7b9aedf1be49', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc949bd-eff7-43e7-918f-5b3f372b6c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:45 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Volume volume-99fd45fa-afb8-4490-9338-7b9aedf1be49 (99fd45fa-afb8-4490-9338-7b9aedf1be49): created successfully Nov 05 03:55:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc949bd-eff7-43e7-918f-5b3f372b6c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:45 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Flow 'volume_create_manager' (821a7b51-4f9e-4aab-a05c-434a4f0b39de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:45 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-68fa5f86-f61a-4eea-aaa2-45228b607816 tempest-ProjectReaderTests-1701832032 None] Created volume successfully. Nov 05 03:55:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-137e1371-8e0d-47cf-95ce-c6c56488c785 tempest-ProjectReaderTests-1701832032 None] Acquiring lock "cinder-99fd45fa-afb8-4490-9338-7b9aedf1be49-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-137e1371-8e0d-47cf-95ce-c6c56488c785 tempest-ProjectReaderTests-1701832032 None] Lock "cinder-99fd45fa-afb8-4490-9338-7b9aedf1be49-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-137e1371-8e0d-47cf-95ce-c6c56488c785 tempest-ProjectReaderTests-1701832032 None] Acquiring lock "cinder-quobyte-99fd45fa-afb8-4490-9338-7b9aedf1be49" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:55:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-137e1371-8e0d-47cf-95ce-c6c56488c785 tempest-ProjectReaderTests-1701832032 None] Lock "cinder-quobyte-99fd45fa-afb8-4490-9338-7b9aedf1be49" acquired by "delete_volume" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:55:46 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1c2d2d-0f27-40d1-880b-b4f8e9b34b52]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:55:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-137e1371-8e0d-47cf-95ce-c6c56488c785 tempest-ProjectReaderTests-1701832032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-99fd45fa-afb8-4490-9338-7b9aedf1be49 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:46 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-99fd45fa-afb8-4490-9338-7b9aedf1be49 Nov 05 03:55:46 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:46 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-137e1371-8e0d-47cf-95ce-c6c56488c785 tempest-ProjectReaderTests-1701832032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-99fd45fa-afb8-4490-9338-7b9aedf1be49" returned: 0 in 0.508s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-137e1371-8e0d-47cf-95ce-c6c56488c785 tempest-ProjectReaderTests-1701832032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-99fd45fa-afb8-4490-9338-7b9aedf1be49 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:46 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-99fd45fa-afb8-4490-9338-7b9aedf1be49 Nov 05 03:55:46 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:47 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-137e1371-8e0d-47cf-95ce-c6c56488c785 tempest-ProjectReaderTests-1701832032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-99fd45fa-afb8-4490-9338-7b9aedf1be49" returned: 0 in 0.341s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-137e1371-8e0d-47cf-95ce-c6c56488c785 tempest-ProjectReaderTests-1701832032 None] Lock "cinder-quobyte-99fd45fa-afb8-4490-9338-7b9aedf1be49" released by "delete_volume" :: held 0.919s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:47 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-137e1371-8e0d-47cf-95ce-c6c56488c785 tempest-ProjectReaderTests-1701832032 None] Created reservations ['a2dc1363-46bf-49eb-af35-18abe56f4b64', '0674d4b2-db0d-4aa5-a573-2fa45a184987', '193306c7-725a-4874-a171-5a80d7164629', '093efdbe-b68f-43d4-a11c-feb39569d66e'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:55:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-137e1371-8e0d-47cf-95ce-c6c56488c785 tempest-ProjectReaderTests-1701832032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-137e1371-8e0d-47cf-95ce-c6c56488c785 tempest-ProjectReaderTests-1701832032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-137e1371-8e0d-47cf-95ce-c6c56488c785 tempest-ProjectReaderTests-1701832032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-137e1371-8e0d-47cf-95ce-c6c56488c785 tempest-ProjectReaderTests-1701832032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-137e1371-8e0d-47cf-95ce-c6c56488c785 tempest-ProjectReaderTests-1701832032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-137e1371-8e0d-47cf-95ce-c6c56488c785 tempest-ProjectReaderTests-1701832032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:47 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:55:47 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:47 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-137e1371-8e0d-47cf-95ce-c6c56488c785 tempest-ProjectReaderTests-1701832032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.327s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:47 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-137e1371-8e0d-47cf-95ce-c6c56488c785 tempest-ProjectReaderTests-1701832032 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:55:47 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-137e1371-8e0d-47cf-95ce-c6c56488c785 tempest-ProjectReaderTests-1701832032 None] Deleted volume successfully. Nov 05 03:55:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-137e1371-8e0d-47cf-95ce-c6c56488c785 tempest-ProjectReaderTests-1701832032 None] Lock "cinder-99fd45fa-afb8-4490-9338-7b9aedf1be49-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Flow 'volume_create_manager' (6fb280e6-bc73-4727-8064-d8a8366d44b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144e1bbc-c71e-4d15-ac2f-e50adf53eb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144e1bbc-c71e-4d15-ac2f-e50adf53eb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-751608896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66477aa2cd7d47d1825ac433097f867c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:53Z,use_quota=True,user_id='63fe1f0593d7498fb5ba6956785b0fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2998ba6-993a-474c-994e-0aa50069ec89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2998ba6-993a-474c-994e-0aa50069ec89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b3b309-321a-46df-9b61-324462264a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b3b309-321a-46df-9b61-324462264a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e', 'volume_name': 'volume-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14118e13-5909-44a9-95a2-b6d35a7cf259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14118e13-5909-44a9-95a2-b6d35a7cf259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa78b223-806e-459d-a9a2-9527f2fa1427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:52 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Volume 7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e', 'volume_size': 1} Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-751608896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66477aa2cd7d47d1825ac433097f867c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:53Z,use_quota=True,user_id='63fe1f0593d7498fb5ba6956785b0fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Creating volume 7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:55:52 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:55:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:52 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e 1073741824 Nov 05 03:55:52 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:53 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e 1073741824" returned: 0 in 0.485s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:53 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e Nov 05 03:55:53 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:53 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e" returned: 0 in 0.256s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:55:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa78b223-806e-459d-a9a2-9527f2fa1427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fe5b7f-2545-4d73-9a8d-2bd8c48c9242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:53 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Volume volume-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e (7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e): created successfully Nov 05 03:55:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fe5b7f-2545-4d73-9a8d-2bd8c48c9242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Flow 'volume_create_manager' (6fb280e6-bc73-4727-8064-d8a8366d44b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:53 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-2493e4d1-d910-46bb-8d65-4a9d9e0c0056 tempest-VolumesListTestJSON-1899252861 None] Created volume successfully. Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Flow 'volume_create_manager' (1ffb63e7-be5d-4739-b88d-75e58a99d1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3be542-002a-44e0-9217-1cf7db293759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3be542-002a-44e0-9217-1cf7db293759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-85805529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1771e67e-a82d-48ca-9210-5158ed8a454f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66477aa2cd7d47d1825ac433097f867c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:55Z,use_quota=True,user_id='63fe1f0593d7498fb5ba6956785b0fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4668c37b-e591-4d66-be2f-fd1bed4857db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4668c37b-e591-4d66-be2f-fd1bed4857db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b80550-40d0-45be-a7f9-a216712a2f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b80550-40d0-45be-a7f9-a216712a2f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1771e67e-a82d-48ca-9210-5158ed8a454f', 'volume_name': 'volume-1771e67e-a82d-48ca-9210-5158ed8a454f', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562c7398-a426-4a44-a329-4bf36a24b910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562c7398-a426-4a44-a329-4bf36a24b910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0ca8e5-bad3-4855-9abf-8c8c45cc2de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:55 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Volume 1771e67e-a82d-48ca-9210-5158ed8a454f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1771e67e-a82d-48ca-9210-5158ed8a454f', 'volume_size': 1} Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-85805529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1771e67e-a82d-48ca-9210-5158ed8a454f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66477aa2cd7d47d1825ac433097f867c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:55Z,use_quota=True,user_id='63fe1f0593d7498fb5ba6956785b0fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Creating volume 1771e67e-a82d-48ca-9210-5158ed8a454f {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:55:55 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:55:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1771e67e-a82d-48ca-9210-5158ed8a454f 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:55 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1771e67e-a82d-48ca-9210-5158ed8a454f 1073741824 Nov 05 03:55:55 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:56 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1771e67e-a82d-48ca-9210-5158ed8a454f 1073741824" returned: 0 in 0.409s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1771e67e-a82d-48ca-9210-5158ed8a454f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:56 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1771e67e-a82d-48ca-9210-5158ed8a454f Nov 05 03:55:56 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:56 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1771e67e-a82d-48ca-9210-5158ed8a454f" returned: 0 in 0.231s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:55:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d0ca8e5-bad3-4855-9abf-8c8c45cc2de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1771e67e-a82d-48ca-9210-5158ed8a454f', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e99f477-4613-4c00-be65-f9ca11f9df0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:56 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Volume volume-1771e67e-a82d-48ca-9210-5158ed8a454f (1771e67e-a82d-48ca-9210-5158ed8a454f): created successfully Nov 05 03:55:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e99f477-4613-4c00-be65-f9ca11f9df0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Flow 'volume_create_manager' (1ffb63e7-be5d-4739-b88d-75e58a99d1f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:56 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f3f2508e-bff7-4c3f-9246-7750aada3790 tempest-VolumesListTestJSON-1899252861 None] Created volume successfully. Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Flow 'volume_create_manager' (86cc01a9-3201-4026-8174-01408f493eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11925854-9795-4cde-ac16-5b551505feb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11925854-9795-4cde-ac16-5b551505feb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1777040541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7440754-99d1-4a24-abb4-217b57aff3b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66477aa2cd7d47d1825ac433097f867c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:57Z,use_quota=True,user_id='63fe1f0593d7498fb5ba6956785b0fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9582588-1bcc-4324-836c-43a10f33c18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9582588-1bcc-4324-836c-43a10f33c18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0b5e41-8c57-420c-acac-15a8270ca4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0b5e41-8c57-420c-acac-15a8270ca4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7440754-99d1-4a24-abb4-217b57aff3b2', 'volume_name': 'volume-b7440754-99d1-4a24-abb4-217b57aff3b2', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ff8726-24dc-4c98-aef7-ce15b2965ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ff8726-24dc-4c98-aef7-ce15b2965ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58eb5fe-38f9-4bbe-8264-bb81c68047b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:57 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Volume b7440754-99d1-4a24-abb4-217b57aff3b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7440754-99d1-4a24-abb4-217b57aff3b2', 'volume_size': 1} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1777040541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7440754-99d1-4a24-abb4-217b57aff3b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66477aa2cd7d47d1825ac433097f867c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:55:57Z,use_quota=True,user_id='63fe1f0593d7498fb5ba6956785b0fd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Creating volume b7440754-99d1-4a24-abb4-217b57aff3b2 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:55:57 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7440754-99d1-4a24-abb4-217b57aff3b2 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:57 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7440754-99d1-4a24-abb4-217b57aff3b2 1073741824 Nov 05 03:55:57 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:57 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7440754-99d1-4a24-abb4-217b57aff3b2 1073741824" returned: 0 in 0.426s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7440754-99d1-4a24-abb4-217b57aff3b2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:57 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7440754-99d1-4a24-abb4-217b57aff3b2 Nov 05 03:55:57 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:57 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7440754-99d1-4a24-abb4-217b57aff3b2" returned: 0 in 0.263s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58eb5fe-38f9-4bbe-8264-bb81c68047b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7440754-99d1-4a24-abb4-217b57aff3b2', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38867df9-d4aa-4e37-8f22-a1f8d56af899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:55:57 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Volume volume-b7440754-99d1-4a24-abb4-217b57aff3b2 (b7440754-99d1-4a24-abb4-217b57aff3b2): created successfully Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38867df9-d4aa-4e37-8f22-a1f8d56af899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:55:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Flow 'volume_create_manager' (86cc01a9-3201-4026-8174-01408f493eb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:55:57 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-965c1acd-95e5-477c-98a6-9224747c60e6 tempest-VolumesListTestJSON-1899252861 None] Created volume successfully. Nov 05 03:55:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:55:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:55:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:55:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:55:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:55:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:55:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:55:58 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:55:58 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:55:58 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Nov 05 03:55:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.266s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:55:58 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:55:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:55:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 28 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:55:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:55:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3ff15322-e0cb-4787-8ad7-0ce3bf6bde94 tempest-VolumesListTestJSON-1899252861 None] Acquiring lock "cinder-b7440754-99d1-4a24-abb4-217b57aff3b2-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3ff15322-e0cb-4787-8ad7-0ce3bf6bde94 tempest-VolumesListTestJSON-1899252861 None] Lock "cinder-b7440754-99d1-4a24-abb4-217b57aff3b2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3ff15322-e0cb-4787-8ad7-0ce3bf6bde94 tempest-VolumesListTestJSON-1899252861 None] Acquiring lock "cinder-quobyte-b7440754-99d1-4a24-abb4-217b57aff3b2" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3ff15322-e0cb-4787-8ad7-0ce3bf6bde94 tempest-VolumesListTestJSON-1899252861 None] Lock "cinder-quobyte-b7440754-99d1-4a24-abb4-217b57aff3b2" acquired by "delete_volume" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:00 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ff8b1d-964a-4c87-8506-0fe70fed56b5]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3ff15322-e0cb-4787-8ad7-0ce3bf6bde94 tempest-VolumesListTestJSON-1899252861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7440754-99d1-4a24-abb4-217b57aff3b2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:00 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7440754-99d1-4a24-abb4-217b57aff3b2 Nov 05 03:56:00 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:00 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3ff15322-e0cb-4787-8ad7-0ce3bf6bde94 tempest-VolumesListTestJSON-1899252861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7440754-99d1-4a24-abb4-217b57aff3b2" returned: 0 in 0.365s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3ff15322-e0cb-4787-8ad7-0ce3bf6bde94 tempest-VolumesListTestJSON-1899252861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7440754-99d1-4a24-abb4-217b57aff3b2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:00 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7440754-99d1-4a24-abb4-217b57aff3b2 Nov 05 03:56:00 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:00 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3ff15322-e0cb-4787-8ad7-0ce3bf6bde94 tempest-VolumesListTestJSON-1899252861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b7440754-99d1-4a24-abb4-217b57aff3b2" returned: 0 in 0.239s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3ff15322-e0cb-4787-8ad7-0ce3bf6bde94 tempest-VolumesListTestJSON-1899252861 None] Lock "cinder-quobyte-b7440754-99d1-4a24-abb4-217b57aff3b2" released by "delete_volume" :: held 0.646s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:00 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-3ff15322-e0cb-4787-8ad7-0ce3bf6bde94 tempest-VolumesListTestJSON-1899252861 None] Created reservations ['e7ecafe6-b580-46e1-8601-5aff1727c3e9', 'bcf9b988-de4b-4272-b320-360f2cb9d32c', 'bb8d34c0-5d1a-45b5-a053-76b8e35de756', 'b28a4103-6003-4335-88b1-4a9e119b911b'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:56:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3ff15322-e0cb-4787-8ad7-0ce3bf6bde94 tempest-VolumesListTestJSON-1899252861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3ff15322-e0cb-4787-8ad7-0ce3bf6bde94 tempest-VolumesListTestJSON-1899252861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3ff15322-e0cb-4787-8ad7-0ce3bf6bde94 tempest-VolumesListTestJSON-1899252861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3ff15322-e0cb-4787-8ad7-0ce3bf6bde94 tempest-VolumesListTestJSON-1899252861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3ff15322-e0cb-4787-8ad7-0ce3bf6bde94 tempest-VolumesListTestJSON-1899252861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3ff15322-e0cb-4787-8ad7-0ce3bf6bde94 tempest-VolumesListTestJSON-1899252861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:00 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:56:00 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:01 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3ff15322-e0cb-4787-8ad7-0ce3bf6bde94 tempest-VolumesListTestJSON-1899252861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.307s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:01 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-3ff15322-e0cb-4787-8ad7-0ce3bf6bde94 tempest-VolumesListTestJSON-1899252861 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:56:01 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-3ff15322-e0cb-4787-8ad7-0ce3bf6bde94 tempest-VolumesListTestJSON-1899252861 None] Deleted volume successfully. Nov 05 03:56:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3ff15322-e0cb-4787-8ad7-0ce3bf6bde94 tempest-VolumesListTestJSON-1899252861 None] Lock "cinder-b7440754-99d1-4a24-abb4-217b57aff3b2-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a7ba2750-434f-4e86-b903-5270d37fc708 tempest-VolumesListTestJSON-1899252861 None] Acquiring lock "cinder-1771e67e-a82d-48ca-9210-5158ed8a454f-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a7ba2750-434f-4e86-b903-5270d37fc708 tempest-VolumesListTestJSON-1899252861 None] Lock "cinder-1771e67e-a82d-48ca-9210-5158ed8a454f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a7ba2750-434f-4e86-b903-5270d37fc708 tempest-VolumesListTestJSON-1899252861 None] Acquiring lock "cinder-quobyte-1771e67e-a82d-48ca-9210-5158ed8a454f" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a7ba2750-434f-4e86-b903-5270d37fc708 tempest-VolumesListTestJSON-1899252861 None] Lock "cinder-quobyte-1771e67e-a82d-48ca-9210-5158ed8a454f" acquired by "delete_volume" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:01 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf23ea7d-969e-4c8b-a31a-2f90437e17a2]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a7ba2750-434f-4e86-b903-5270d37fc708 tempest-VolumesListTestJSON-1899252861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1771e67e-a82d-48ca-9210-5158ed8a454f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:01 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1771e67e-a82d-48ca-9210-5158ed8a454f Nov 05 03:56:01 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:01 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a7ba2750-434f-4e86-b903-5270d37fc708 tempest-VolumesListTestJSON-1899252861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1771e67e-a82d-48ca-9210-5158ed8a454f" returned: 0 in 0.449s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a7ba2750-434f-4e86-b903-5270d37fc708 tempest-VolumesListTestJSON-1899252861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1771e67e-a82d-48ca-9210-5158ed8a454f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:01 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1771e67e-a82d-48ca-9210-5158ed8a454f Nov 05 03:56:01 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:02 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a7ba2750-434f-4e86-b903-5270d37fc708 tempest-VolumesListTestJSON-1899252861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1771e67e-a82d-48ca-9210-5158ed8a454f" returned: 0 in 0.258s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:02 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a7ba2750-434f-4e86-b903-5270d37fc708 tempest-VolumesListTestJSON-1899252861 None] Lock "cinder-quobyte-1771e67e-a82d-48ca-9210-5158ed8a454f" released by "delete_volume" :: held 0.752s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:02 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-a7ba2750-434f-4e86-b903-5270d37fc708 tempest-VolumesListTestJSON-1899252861 None] Created reservations ['d1018e6b-3eab-4cb7-85ee-69793eb8a30d', '3c984f61-cfce-4800-b746-84b2e3cc5eca', '189d09d8-5b51-4165-8928-a8b194df69c1', '9471ddaa-8611-49ac-85a7-173dbc748cfb'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:56:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a7ba2750-434f-4e86-b903-5270d37fc708 tempest-VolumesListTestJSON-1899252861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a7ba2750-434f-4e86-b903-5270d37fc708 tempest-VolumesListTestJSON-1899252861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:02 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a7ba2750-434f-4e86-b903-5270d37fc708 tempest-VolumesListTestJSON-1899252861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:02 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a7ba2750-434f-4e86-b903-5270d37fc708 tempest-VolumesListTestJSON-1899252861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a7ba2750-434f-4e86-b903-5270d37fc708 tempest-VolumesListTestJSON-1899252861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a7ba2750-434f-4e86-b903-5270d37fc708 tempest-VolumesListTestJSON-1899252861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:02 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:56:02 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:02 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:02 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-50d7a86f-e07f-4ba6-8a55-3073a7616055 tempest-VolumesListTestJSON-1899252861 None] Acquiring lock "cinder-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a7ba2750-434f-4e86-b903-5270d37fc708 tempest-VolumesListTestJSON-1899252861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.261s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:02 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-a7ba2750-434f-4e86-b903-5270d37fc708 tempest-VolumesListTestJSON-1899252861 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:56:02 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-a7ba2750-434f-4e86-b903-5270d37fc708 tempest-VolumesListTestJSON-1899252861 None] Deleted volume successfully. Nov 05 03:56:02 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-50d7a86f-e07f-4ba6-8a55-3073a7616055 tempest-VolumesListTestJSON-1899252861 None] Lock "cinder-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:02 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a7ba2750-434f-4e86-b903-5270d37fc708 tempest-VolumesListTestJSON-1899252861 None] Lock "cinder-1771e67e-a82d-48ca-9210-5158ed8a454f-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:02 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-50d7a86f-e07f-4ba6-8a55-3073a7616055 tempest-VolumesListTestJSON-1899252861 None] Acquiring lock "cinder-quobyte-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:02 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-50d7a86f-e07f-4ba6-8a55-3073a7616055 tempest-VolumesListTestJSON-1899252861 None] Lock "cinder-quobyte-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e" acquired by "delete_volume" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:02 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[57900ec4-72d6-4d51-a2db-99cb970fa923]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-50d7a86f-e07f-4ba6-8a55-3073a7616055 tempest-VolumesListTestJSON-1899252861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:02 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e Nov 05 03:56:02 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:03 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-50d7a86f-e07f-4ba6-8a55-3073a7616055 tempest-VolumesListTestJSON-1899252861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e" returned: 0 in 0.426s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-50d7a86f-e07f-4ba6-8a55-3073a7616055 tempest-VolumesListTestJSON-1899252861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:03 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e Nov 05 03:56:03 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:03 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-50d7a86f-e07f-4ba6-8a55-3073a7616055 tempest-VolumesListTestJSON-1899252861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e" returned: 0 in 0.256s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:03 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-50d7a86f-e07f-4ba6-8a55-3073a7616055 tempest-VolumesListTestJSON-1899252861 None] Lock "cinder-quobyte-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e" released by "delete_volume" :: held 0.729s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:03 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=82,cinder:UPDATE=82,cinder:INSERT=27,cinder:DELETE=9 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:56:03 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-50d7a86f-e07f-4ba6-8a55-3073a7616055 tempest-VolumesListTestJSON-1899252861 None] Created reservations ['1678bee0-8510-4050-b3ec-c6a5f4e48ade', '5e8d7d58-741f-469f-b001-a3a9d36d0e99', '0096690f-e8b6-4a87-8a60-8767335dcf2b', '94f72944-be93-4e91-a1cc-8a10be85a236'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:56:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-50d7a86f-e07f-4ba6-8a55-3073a7616055 tempest-VolumesListTestJSON-1899252861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-50d7a86f-e07f-4ba6-8a55-3073a7616055 tempest-VolumesListTestJSON-1899252861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-50d7a86f-e07f-4ba6-8a55-3073a7616055 tempest-VolumesListTestJSON-1899252861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-50d7a86f-e07f-4ba6-8a55-3073a7616055 tempest-VolumesListTestJSON-1899252861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-50d7a86f-e07f-4ba6-8a55-3073a7616055 tempest-VolumesListTestJSON-1899252861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-50d7a86f-e07f-4ba6-8a55-3073a7616055 tempest-VolumesListTestJSON-1899252861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:03 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:56:03 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:03 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-50d7a86f-e07f-4ba6-8a55-3073a7616055 tempest-VolumesListTestJSON-1899252861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.276s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:03 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-50d7a86f-e07f-4ba6-8a55-3073a7616055 tempest-VolumesListTestJSON-1899252861 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:56:03 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-50d7a86f-e07f-4ba6-8a55-3073a7616055 tempest-VolumesListTestJSON-1899252861 None] Deleted volume successfully. Nov 05 03:56:03 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-50d7a86f-e07f-4ba6-8a55-3073a7616055 tempest-VolumesListTestJSON-1899252861 None] Lock "cinder-7b063d8a-b7ae-4a5e-b00f-21cdb271fa5e-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:07 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:56:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Flow 'volume_create_manager' (cc802e35-1a0c-49fb-bba5-5a0bee34f9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:56:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c9fc9d-048b-433e-ad17-b276395de6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c9fc9d-048b-433e-ad17-b276395de6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-913291246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e74b0f-1718-4522-9ccf-d126958dfaba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d1301953224d0bb343e6b832dced31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:08Z,use_quota=True,user_id='28968127acb34378a5d5f30aa1816952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a91322-df29-4246-aeea-93407bc15a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a91322-df29-4246-aeea-93407bc15a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1153ca3-18e2-4585-9459-f374dfc013f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1153ca3-18e2-4585-9459-f374dfc013f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4e74b0f-1718-4522-9ccf-d126958dfaba', 'volume_name': 'volume-a4e74b0f-1718-4522-9ccf-d126958dfaba', 'volume_size': 2}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94aa3e5-9d6b-4c52-a5a9-c0c3bfd724ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94aa3e5-9d6b-4c52-a5a9-c0c3bfd724ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67b3dff-4b20-41d9-ae19-dfdfb85f1468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:08 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Volume a4e74b0f-1718-4522-9ccf-d126958dfaba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4e74b0f-1718-4522-9ccf-d126958dfaba', 'volume_size': 2} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-913291246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e74b0f-1718-4522-9ccf-d126958dfaba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d1301953224d0bb343e6b832dced31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:08Z,use_quota=True,user_id='28968127acb34378a5d5f30aa1816952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Creating volume a4e74b0f-1718-4522-9ccf-d126958dfaba {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:56:08 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba 2147483648 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:08 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba 2147483648 Nov 05 03:56:08 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:08 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba 2147483648" returned: 0 in 0.546s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:08 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba Nov 05 03:56:08 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-06b3052a-e45d-4eb0-b241-3cb6b96e9f53 req-14163985-b29e-469e-b37c-e66fa4b4fa60 tempest-TestInstancesWithCinderVolumes-831072736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:08 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba" returned: 0 in 0.258s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-06b3052a-e45d-4eb0-b241-3cb6b96e9f53 req-14163985-b29e-469e-b37c-e66fa4b4fa60 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.071s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-06b3052a-e45d-4eb0-b241-3cb6b96e9f53 req-14163985-b29e-469e-b37c-e66fa4b4fa60 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67b3dff-4b20-41d9-ae19-dfdfb85f1468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4e74b0f-1718-4522-9ccf-d126958dfaba', 'volume_size': 2}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d93719b-c7c5-4aa2-a1e0-be689e0435be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:08 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Volume volume-a4e74b0f-1718-4522-9ccf-d126958dfaba (a4e74b0f-1718-4522-9ccf-d126958dfaba): created successfully Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d93719b-c7c5-4aa2-a1e0-be689e0435be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Flow 'volume_create_manager' (cc802e35-1a0c-49fb-bba5-5a0bee34f9e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:56:08 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-e8d12adf-7dc6-4a26-9619-6de695733ee3 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Created volume successfully. Nov 05 03:56:08 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-06b3052a-e45d-4eb0-b241-3cb6b96e9f53 req-14163985-b29e-469e-b37c-e66fa4b4fa60 tempest-TestInstancesWithCinderVolumes-831072736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a24c444-e84d-4b8b-b726-0b9b5293aaf5', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:56:09 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-06b3052a-e45d-4eb0-b241-3cb6b96e9f53 req-14163985-b29e-469e-b37c-e66fa4b4fa60 tempest-TestInstancesWithCinderVolumes-831072736 None] attachment_update completed successfully. Nov 05 03:56:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e969d95e-f611-4070-90e2-44ea640447b8 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e969d95e-f611-4070-90e2-44ea640447b8 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-e969d95e-f611-4070-90e2-44ea640447b8 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Creating offline snapshot 59d5dd0c-1536-4007-aa68-e3d5e3b9b818 of volume a4e74b0f-1718-4522-9ccf-d126958dfaba {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:56:10 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e822b6e8-3756-485a-9a70-0b4a9b620059]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e969d95e-f611-4070-90e2-44ea640447b8 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:10 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba Nov 05 03:56:10 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:10 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e969d95e-f611-4070-90e2-44ea640447b8 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba" returned: 0 in 0.416s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e969d95e-f611-4070-90e2-44ea640447b8 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.59d5dd0c-1536-4007-aa68-e3d5e3b9b818 2G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:10 devstack sudo[102794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.59d5dd0c-1536-4007-aa68-e3d5e3b9b818 2G Nov 05 03:56:10 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-e0fdd454-7afa-48fc-821b-7b01528c1849 req-a24ff291-51ba-4d28-a970-2a9cb4591397 tempest-TestInstancesWithCinderVolumes-831072736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:11 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e969d95e-f611-4070-90e2-44ea640447b8 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.59d5dd0c-1536-4007-aa68-e3d5e3b9b818 2G" returned: 0 in 0.411s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e969d95e-f611-4070-90e2-44ea640447b8 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4e74b0f-1718-4522-9ccf-d126958dfaba -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.59d5dd0c-1536-4007-aa68-e3d5e3b9b818 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:11 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4e74b0f-1718-4522-9ccf-d126958dfaba -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.59d5dd0c-1536-4007-aa68-e3d5e3b9b818 Nov 05 03:56:11 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:11 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e969d95e-f611-4070-90e2-44ea640447b8 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4e74b0f-1718-4522-9ccf-d126958dfaba -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.59d5dd0c-1536-4007-aa68-e3d5e3b9b818" returned: 0 in 0.288s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:11 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-e969d95e-f611-4070-90e2-44ea640447b8 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.59d5dd0c-1536-4007-aa68-e3d5e3b9b818 is being set with open permissions: ugo+rw Nov 05 03:56:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e969d95e-f611-4070-90e2-44ea640447b8 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.59d5dd0c-1536-4007-aa68-e3d5e3b9b818 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:11 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.59d5dd0c-1536-4007-aa68-e3d5e3b9b818 Nov 05 03:56:11 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:11 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e969d95e-f611-4070-90e2-44ea640447b8 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.59d5dd0c-1536-4007-aa68-e3d5e3b9b818" returned: 0 in 0.233s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e969d95e-f611-4070-90e2-44ea640447b8 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:11 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.info Nov 05 03:56:11 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:11 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e969d95e-f611-4070-90e2-44ea640447b8 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.info" returned: 0 in 0.254s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:11 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-e969d95e-f611-4070-90e2-44ea640447b8 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.info is being set with open permissions: ugo+rw Nov 05 03:56:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e969d95e-f611-4070-90e2-44ea640447b8 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:11 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.info Nov 05 03:56:11 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:12 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e969d95e-f611-4070-90e2-44ea640447b8 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.info" returned: 0 in 0.247s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e969d95e-f611-4070-90e2-44ea640447b8 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.948s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-e0fdd454-7afa-48fc-821b-7b01528c1849 req-a24ff291-51ba-4d28-a970-2a9cb4591397 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.233s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-e0fdd454-7afa-48fc-821b-7b01528c1849 req-a24ff291-51ba-4d28-a970-2a9cb4591397 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:12 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-e969d95e-f611-4070-90e2-44ea640447b8 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Create snapshot completed successfully Nov 05 03:56:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-e0fdd454-7afa-48fc-821b-7b01528c1849 req-a24ff291-51ba-4d28-a970-2a9cb4591397 tempest-TestInstancesWithCinderVolumes-831072736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-27587756-e2e9-43b3-9a50-8b5d9c52360d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8066879-c55f-4791-827e-f8ef1cfd6d93', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:56:12 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-e0fdd454-7afa-48fc-821b-7b01528c1849 req-a24ff291-51ba-4d28-a970-2a9cb4591397 tempest-TestInstancesWithCinderVolumes-831072736 None] attachment_update completed successfully. Nov 05 03:56:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Acquiring lock "cinder-59d5dd0c-1536-4007-aa68-e3d5e3b9b818-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Lock "cinder-59d5dd0c-1536-4007-aa68-e3d5e3b9b818-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Acquiring lock "cinder-quobyte-a4e74b0f-1718-4522-9ccf-d126958dfaba" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Lock "cinder-quobyte-a4e74b0f-1718-4522-9ccf-d126958dfaba" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Acquiring lock "cinder-quobyte-59d5dd0c-1536-4007-aa68-e3d5e3b9b818" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Lock "cinder-quobyte-59d5dd0c-1536-4007-aa68-e3d5e3b9b818" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Deleting offline snapshot 59d5dd0c-1536-4007-aa68-e3d5e3b9b818 of volume a4e74b0f-1718-4522-9ccf-d126958dfaba {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:56:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] snapshot_file for this snap is: volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.59d5dd0c-1536-4007-aa68-e3d5e3b9b818 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:56:12 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c0a689-06b0-4b90-9013-9fdd67f63971]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.59d5dd0c-1536-4007-aa68-e3d5e3b9b818 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:12 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.59d5dd0c-1536-4007-aa68-e3d5e3b9b818 Nov 05 03:56:12 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:12 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.59d5dd0c-1536-4007-aa68-e3d5e3b9b818" returned: 0 in 0.466s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4e74b0f-1718-4522-9ccf-d126958dfaba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:56:13 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[128e7760-5f98-4bfc-b976-9051b67d0387]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:13 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba Nov 05 03:56:13 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:13 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba" returned: 0 in 0.360s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.59d5dd0c-1536-4007-aa68-e3d5e3b9b818 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:13 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.59d5dd0c-1536-4007-aa68-e3d5e3b9b818 Nov 05 03:56:13 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:13 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.59d5dd0c-1536-4007-aa68-e3d5e3b9b818" returned: 0 in 0.337s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.59d5dd0c-1536-4007-aa68-e3d5e3b9b818 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:13 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.59d5dd0c-1536-4007-aa68-e3d5e3b9b818 Nov 05 03:56:13 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:13 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba.59d5dd0c-1536-4007-aa68-e3d5e3b9b818" returned: 0 in 0.253s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Lock "cinder-quobyte-59d5dd0c-1536-4007-aa68-e3d5e3b9b818" released by "_delete_snapshot" :: held 1.547s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Lock "cinder-quobyte-a4e74b0f-1718-4522-9ccf-d126958dfaba" released by "delete_snapshot" :: held 1.576s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:14 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Created reservations ['248c80bc-1486-4e16-85d2-bf8704adf59e', '9b1836a6-7bfd-4d7b-9d48-484bfdcd30dd', '81801705-7909-4a67-a8a1-32733c2f53da', '1f62a47f-ca70-4bba-9ae0-cda3751e907b'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:56:14 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Delete snapshot completed successfully. Nov 05 03:56:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-44ce1ef8-6b33-4aed-a055-e8ce6308d1b2 tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Lock "cinder-59d5dd0c-1536-4007-aa68-e3d5e3b9b818-delete_snapshot" released by "delete_snapshot" :: held 1.729s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-927ca137-7f56-4040-91fb-f02cdc0b46ed tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Acquiring lock "cinder-a4e74b0f-1718-4522-9ccf-d126958dfaba-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-927ca137-7f56-4040-91fb-f02cdc0b46ed tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Lock "cinder-a4e74b0f-1718-4522-9ccf-d126958dfaba-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-927ca137-7f56-4040-91fb-f02cdc0b46ed tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Acquiring lock "cinder-quobyte-a4e74b0f-1718-4522-9ccf-d126958dfaba" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-927ca137-7f56-4040-91fb-f02cdc0b46ed tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Lock "cinder-quobyte-a4e74b0f-1718-4522-9ccf-d126958dfaba" acquired by "delete_volume" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:14 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[4386e468-5072-4959-b1f0-16ceb10685d9]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-927ca137-7f56-4040-91fb-f02cdc0b46ed tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:14 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba Nov 05 03:56:14 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:15 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-927ca137-7f56-4040-91fb-f02cdc0b46ed tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba" returned: 0 in 0.385s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-927ca137-7f56-4040-91fb-f02cdc0b46ed tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:15 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba Nov 05 03:56:15 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:15 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-927ca137-7f56-4040-91fb-f02cdc0b46ed tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a4e74b0f-1718-4522-9ccf-d126958dfaba" returned: 0 in 0.259s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:15 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-927ca137-7f56-4040-91fb-f02cdc0b46ed tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Lock "cinder-quobyte-a4e74b0f-1718-4522-9ccf-d126958dfaba" released by "delete_volume" :: held 0.715s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:15 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-927ca137-7f56-4040-91fb-f02cdc0b46ed tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Created reservations ['166a9329-7601-4c6c-8aea-94196936b718', 'adbc09bc-fe0b-4a45-be11-8057b99ca399', 'eeb82048-79ff-4122-b300-fc212e270197', 'c0c46ed7-e8d1-41ed-92ed-0656cef51dae'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:56:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-927ca137-7f56-4040-91fb-f02cdc0b46ed tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-927ca137-7f56-4040-91fb-f02cdc0b46ed tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-927ca137-7f56-4040-91fb-f02cdc0b46ed tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-927ca137-7f56-4040-91fb-f02cdc0b46ed tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-927ca137-7f56-4040-91fb-f02cdc0b46ed tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-927ca137-7f56-4040-91fb-f02cdc0b46ed tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:15 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:56:15 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:15 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-927ca137-7f56-4040-91fb-f02cdc0b46ed tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.270s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:15 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-927ca137-7f56-4040-91fb-f02cdc0b46ed tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:56:15 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-927ca137-7f56-4040-91fb-f02cdc0b46ed tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Deleted volume successfully. Nov 05 03:56:15 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-927ca137-7f56-4040-91fb-f02cdc0b46ed tempest-VolumesSnapshotNegativeTestJSON-1866662820 None] Lock "cinder-a4e74b0f-1718-4522-9ccf-d126958dfaba-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:18 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-ed13cc78-297f-419a-87d9-5df42f4b7258 req-d2d34d42-1184-40c5-afa7-d9a8e5dfa408 tempest-TestInstancesWithCinderVolumes-831072736 None] Terminate volume connection completed successfully. Nov 05 03:56:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-ed13cc78-297f-419a-87d9-5df42f4b7258 req-d2d34d42-1184-40c5-afa7-d9a8e5dfa408 tempest-TestInstancesWithCinderVolumes-831072736 None] Deleting attachment 0a24c444-e84d-4b8b-b726-0b9b5293aaf5. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:56:19 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] Acquiring lock "cinder-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:19 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "cinder-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:19 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] Acquiring lock "cinder-quobyte-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:19 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "cinder-quobyte-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a" acquired by "delete_volume" :: waited 0.034s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:19 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[493e344c-cc7b-41ad-b45b-82d46686e95c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:19 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a Nov 05 03:56:19 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:19 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a" returned: 0 in 0.526s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:19 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a Nov 05 03:56:19 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:20 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a" returned: 0 in 0.334s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "cinder-quobyte-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a" released by "delete_volume" :: held 0.943s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:20 devstack cinder-volume[87109]: WARNING cinder.quota [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-723524759-1718926990 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-723524759-1718926990, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:56:20 devstack cinder-volume[87109]: WARNING cinder.quota [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-723524759-1718926990 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-723524759-1718926990, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:56:20 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] Created reservations ['60e01d3b-a636-43d3-a85b-dd0cf91649da', '32930a85-515d-4f81-8c8d-66a5a8c0c8e3', '256c89f0-217d-44a3-a238-48a6fc199491', '1c7dd1a9-24ca-4367-916e-0be10d88d197'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:56:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:20 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:56:20 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:20 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.303s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:20 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:56:20 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] Deleted volume successfully. Nov 05 03:56:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5ad3224d-ef65-4287-a09e-ba09fb3bac37 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "cinder-f4a65aa6-4fb0-4e4c-919a-da1870cc0d1a-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:23 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-684ea140-c8b3-4e6b-a2f7-96f2b29fedba req-15a5397b-331d-46a7-9083-5765e6a94ef9 tempest-TestInstancesWithCinderVolumes-831072736 None] Terminate volume connection completed successfully. Nov 05 03:56:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-684ea140-c8b3-4e6b-a2f7-96f2b29fedba req-15a5397b-331d-46a7-9083-5765e6a94ef9 tempest-TestInstancesWithCinderVolumes-831072736 None] Deleting attachment f8066879-c55f-4791-827e-f8ef1cfd6d93. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:56:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] Acquiring lock "cinder-27587756-e2e9-43b3-9a50-8b5d9c52360d-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "cinder-27587756-e2e9-43b3-9a50-8b5d9c52360d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] Acquiring lock "cinder-quobyte-27587756-e2e9-43b3-9a50-8b5d9c52360d" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "cinder-quobyte-27587756-e2e9-43b3-9a50-8b5d9c52360d" acquired by "delete_volume" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:24 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1e83bd-2fa5-48f2-995a-ac288aa4a2e1]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-27587756-e2e9-43b3-9a50-8b5d9c52360d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:24 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-27587756-e2e9-43b3-9a50-8b5d9c52360d Nov 05 03:56:24 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:25 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-27587756-e2e9-43b3-9a50-8b5d9c52360d" returned: 0 in 0.513s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-27587756-e2e9-43b3-9a50-8b5d9c52360d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:25 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-27587756-e2e9-43b3-9a50-8b5d9c52360d Nov 05 03:56:25 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:25 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-27587756-e2e9-43b3-9a50-8b5d9c52360d" returned: 0 in 0.286s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "cinder-quobyte-27587756-e2e9-43b3-9a50-8b5d9c52360d" released by "delete_volume" :: held 0.859s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:25 devstack cinder-volume[87109]: WARNING cinder.quota [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1858233245-1824166143 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1858233245-1824166143, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:56:25 devstack cinder-volume[87109]: WARNING cinder.quota [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1858233245-1824166143 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1858233245-1824166143, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:56:25 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] Created reservations ['2dd4b93a-8d6d-474e-8f90-4a8fe696d5fe', '5d030f60-e15d-436f-88b7-7f7176b0a20c', 'e2d69a87-2b3a-421a-bb43-f434f4a990f4', 'a8208846-140e-4da8-af41-dcfa7468eb19'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:56:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:25 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:56:25 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:25 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.289s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:25 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:56:25 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] Deleted volume successfully. Nov 05 03:56:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2ff85cb6-c14b-4ec6-af73-d3c00404d519 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "cinder-27587756-e2e9-43b3-9a50-8b5d9c52360d-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:31 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-9ddf23f9-f7c6-47d0-9f54-ec3498b35a5f req-3144b391-f78b-45ad-9df5-07548896de36 tempest-TestInstancesWithCinderVolumes-831072736 None] Terminate volume connection completed successfully. Nov 05 03:56:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-9ddf23f9-f7c6-47d0-9f54-ec3498b35a5f req-3144b391-f78b-45ad-9df5-07548896de36 tempest-TestInstancesWithCinderVolumes-831072736 None] Deleting attachment f4f8788c-d69a-4396-b9a8-be191b0aac78. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:56:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] Acquiring lock "cinder-c37b9a41-a351-4933-a8b4-e353b2976d98-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "cinder-c37b9a41-a351-4933-a8b4-e353b2976d98-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:32 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=106,cinder:UPDATE=114,cinder:INSERT=26,cinder:DELETE=10 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:56:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] Acquiring lock "cinder-quobyte-c37b9a41-a351-4933-a8b4-e353b2976d98" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:56:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "cinder-quobyte-c37b9a41-a351-4933-a8b4-e353b2976d98" acquired by "delete_volume" :: waited 0.013s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:56:32 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9748c5f-54a8-4ea2-962a-bda9ba5de659]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:56:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c37b9a41-a351-4933-a8b4-e353b2976d98 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:33 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c37b9a41-a351-4933-a8b4-e353b2976d98 Nov 05 03:56:33 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:33 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c37b9a41-a351-4933-a8b4-e353b2976d98" returned: 0 in 0.363s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c37b9a41-a351-4933-a8b4-e353b2976d98 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:33 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c37b9a41-a351-4933-a8b4-e353b2976d98 Nov 05 03:56:33 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:33 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c37b9a41-a351-4933-a8b4-e353b2976d98" returned: 0 in 0.251s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "cinder-quobyte-c37b9a41-a351-4933-a8b4-e353b2976d98" released by "delete_volume" :: held 0.657s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:33 devstack cinder-volume[87109]: WARNING cinder.quota [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-148979806-1608343783 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-148979806-1608343783, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:56:33 devstack cinder-volume[87109]: WARNING cinder.quota [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-148979806-1608343783 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-148979806-1608343783, it is now deprecated. Please use the default quota class for default quota. Nov 05 03:56:33 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] Created reservations ['5d03abff-6fbb-436a-81cc-e0d02626d762', '0e7529ff-82d1-4a8e-bfcf-1a0a00994787', 'a4fac393-41ac-454a-a43f-a2fd5155c9e6', 'b05214a0-8d6b-40e8-b4a0-0bdf0789057e'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:56:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:33 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:56:33 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:33 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.241s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:33 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:56:33 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] Deleted volume successfully. Nov 05 03:56:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-91ce1641-aa06-4d0f-91cb-1ac965809ad8 tempest-TestInstancesWithCinderVolumes-831072736 None] Lock "cinder-c37b9a41-a351-4933-a8b4-e353b2976d98-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:56:43 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=2,cinder:INSERT=4,cinder:UPDATE=8 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:56:43 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=55,cinder:INSERT=10,cinder:UPDATE=58,cinder:DELETE=3 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Flow 'volume_create_manager' (3b9bda4d-b661-4cd9-9d06-36b9b637577d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172e8772-9613-4e92-9102-519e51daddd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172e8772-9613-4e92-9102-519e51daddd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-850753173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef7ce4f-62ff-4611-9a0e-afb7406a620e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2da5ba2e1b14396b94a51711b81878f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:53Z,use_quota=True,user_id='e29a71f3a38a407f9fd3101fa9e95478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8327ffea-c0a8-466d-a256-a8e7764d3dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8327ffea-c0a8-466d-a256-a8e7764d3dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325faf62-2af5-4871-a672-1c17c83d2ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325faf62-2af5-4871-a672-1c17c83d2ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ef7ce4f-62ff-4611-9a0e-afb7406a620e', 'volume_name': 'volume-7ef7ce4f-62ff-4611-9a0e-afb7406a620e', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192a60be-ea7f-42e8-812a-5c05b0e63998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (192a60be-ea7f-42e8-812a-5c05b0e63998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba00e2f-7c09-426d-b67a-392cde0d0800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:53 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Volume 7ef7ce4f-62ff-4611-9a0e-afb7406a620e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ef7ce4f-62ff-4611-9a0e-afb7406a620e', 'volume_size': 1} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-850753173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef7ce4f-62ff-4611-9a0e-afb7406a620e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2da5ba2e1b14396b94a51711b81878f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:56:53Z,use_quota=True,user_id='e29a71f3a38a407f9fd3101fa9e95478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Creating volume 7ef7ce4f-62ff-4611-9a0e-afb7406a620e {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:56:53 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7ef7ce4f-62ff-4611-9a0e-afb7406a620e 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:53 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7ef7ce4f-62ff-4611-9a0e-afb7406a620e 1073741824 Nov 05 03:56:53 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:53 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7ef7ce4f-62ff-4611-9a0e-afb7406a620e 1073741824" returned: 0 in 0.550s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7ef7ce4f-62ff-4611-9a0e-afb7406a620e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:53 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7ef7ce4f-62ff-4611-9a0e-afb7406a620e Nov 05 03:56:53 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:53 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7ef7ce4f-62ff-4611-9a0e-afb7406a620e" returned: 0 in 0.269s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:56:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba00e2f-7c09-426d-b67a-392cde0d0800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ef7ce4f-62ff-4611-9a0e-afb7406a620e', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b955c0f-eef2-48b9-a8e1-f90def1d4ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:56:54 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Volume volume-7ef7ce4f-62ff-4611-9a0e-afb7406a620e (7ef7ce4f-62ff-4611-9a0e-afb7406a620e): created successfully Nov 05 03:56:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b955c0f-eef2-48b9-a8e1-f90def1d4ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:56:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Flow 'volume_create_manager' (3b9bda4d-b661-4cd9-9d06-36b9b637577d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:56:54 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-e80e0b5c-5ba7-4028-958f-dc80926e3589 tempest-TestMinimumBasicScenario-1694014871 None] Created volume successfully. Nov 05 03:56:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-1732c506-d918-4113-a08d-f329b81ee72c req-c11b1fbb-d5e7-42ea-a342-4c32567aaec5 tempest-TestMinimumBasicScenario-1694014871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-1732c506-d918-4113-a08d-f329b81ee72c req-c11b1fbb-d5e7-42ea-a342-4c32567aaec5 tempest-TestMinimumBasicScenario-1694014871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-1732c506-d918-4113-a08d-f329b81ee72c req-c11b1fbb-d5e7-42ea-a342-4c32567aaec5 tempest-TestMinimumBasicScenario-1694014871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-1732c506-d918-4113-a08d-f329b81ee72c req-c11b1fbb-d5e7-42ea-a342-4c32567aaec5 tempest-TestMinimumBasicScenario-1694014871 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-7ef7ce4f-62ff-4611-9a0e-afb7406a620e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f480afa-199d-4ff0-a655-e5dececf218e', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:56:56 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-1732c506-d918-4113-a08d-f329b81ee72c req-c11b1fbb-d5e7-42ea-a342-4c32567aaec5 tempest-TestMinimumBasicScenario-1694014871 None] attachment_update completed successfully. Nov 05 03:56:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:56:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:56:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:56:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:56:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:56:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:56:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:56:58 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:56:58 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:56:58 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Nov 05 03:56:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.385s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:56:58 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:56:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:56:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 28 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:56:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:57:06 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:UPDATE=5,cinder:SELECT=5 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:57:06 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:57:13 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:57:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Flow 'volume_create_manager' (de0aa403-4d07-48ad-8feb-a59ccf118f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24360085-ec57-4088-9128-bca8f68f0c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24360085-ec57-4088-9128-bca8f68f0c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-309643112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81790c5f-9d9b-4114-8bf3-2baaa317eb45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c3e3c28f0e4d218543bfe11012ac5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:14Z,use_quota=True,user_id='4b33ea2218bb4982b2ad849bb2b922a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b06fb4-fb53-454e-98d6-4bc74a8b414d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b06fb4-fb53-454e-98d6-4bc74a8b414d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3fbb3b5-5687-46fb-bd7c-090320701075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3fbb3b5-5687-46fb-bd7c-090320701075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81790c5f-9d9b-4114-8bf3-2baaa317eb45', 'volume_name': 'volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e2bb1e-3e7e-4a66-bc7f-232858661a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e2bb1e-3e7e-4a66-bc7f-232858661a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5103abb-8c69-467f-8c92-5718ec4fa135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:14 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Volume 81790c5f-9d9b-4114-8bf3-2baaa317eb45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45', 'volume_size': 1} Nov 05 03:57:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-309643112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81790c5f-9d9b-4114-8bf3-2baaa317eb45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c3e3c28f0e4d218543bfe11012ac5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:57:14Z,use_quota=True,user_id='4b33ea2218bb4982b2ad849bb2b922a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:57:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Creating volume 81790c5f-9d9b-4114-8bf3-2baaa317eb45 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:57:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:57:14 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:57:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:14 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 1073741824 Nov 05 03:57:14 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:14 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 1073741824" returned: 0 in 0.608s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:14 devstack sudo[103658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 Nov 05 03:57:14 devstack sudo[103658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:14 devstack sudo[103658]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45" returned: 0 in 0.318s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:57:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5103abb-8c69-467f-8c92-5718ec4fa135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa961b74-9a5f-41b3-bebc-ef65a8002c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:57:15 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Volume volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 (81790c5f-9d9b-4114-8bf3-2baaa317eb45): created successfully Nov 05 03:57:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa961b74-9a5f-41b3-bebc-ef65a8002c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:57:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Flow 'volume_create_manager' (de0aa403-4d07-48ad-8feb-a59ccf118f0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:57:15 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-1e721376-684a-4d6d-91d8-57d40091dd48 tempest-TestStampPattern-1741259215 None] Created volume successfully. Nov 05 03:57:25 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:57:25 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:57:43 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-77459162-cd7b-4977-ac8e-b73464382fc0 req-9394aa50-1b45-4bf6-9e77-11261fd08fe2 tempest-TestMinimumBasicScenario-1694014871 None] Terminate volume connection completed successfully. Nov 05 03:57:43 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-77459162-cd7b-4977-ac8e-b73464382fc0 req-9394aa50-1b45-4bf6-9e77-11261fd08fe2 tempest-TestMinimumBasicScenario-1694014871 None] Deleting attachment 9f480afa-199d-4ff0-a655-e5dececf218e. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:57:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c682e5cb-924e-4d1e-ad6d-87002d6f9639 tempest-TestMinimumBasicScenario-1694014871 None] Acquiring lock "cinder-7ef7ce4f-62ff-4611-9a0e-afb7406a620e-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c682e5cb-924e-4d1e-ad6d-87002d6f9639 tempest-TestMinimumBasicScenario-1694014871 None] Lock "cinder-7ef7ce4f-62ff-4611-9a0e-afb7406a620e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c682e5cb-924e-4d1e-ad6d-87002d6f9639 tempest-TestMinimumBasicScenario-1694014871 None] Acquiring lock "cinder-quobyte-7ef7ce4f-62ff-4611-9a0e-afb7406a620e" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:57:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c682e5cb-924e-4d1e-ad6d-87002d6f9639 tempest-TestMinimumBasicScenario-1694014871 None] Lock "cinder-quobyte-7ef7ce4f-62ff-4611-9a0e-afb7406a620e" acquired by "delete_volume" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:57:44 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[9784885e-7709-42e9-a89c-f82d2e4dac34]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c682e5cb-924e-4d1e-ad6d-87002d6f9639 tempest-TestMinimumBasicScenario-1694014871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7ef7ce4f-62ff-4611-9a0e-afb7406a620e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-2182ac9b-36d5-4f63-bc75-ee4a71f323e3 req-f0c12164-ce93-4aff-936c-801fc56d4b7f tempest-TestStampPattern-1741259215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-2182ac9b-36d5-4f63-bc75-ee4a71f323e3 req-f0c12164-ce93-4aff-936c-801fc56d4b7f tempest-TestStampPattern-1741259215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-2182ac9b-36d5-4f63-bc75-ee4a71f323e3 req-f0c12164-ce93-4aff-936c-801fc56d4b7f tempest-TestStampPattern-1741259215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:44 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-2182ac9b-36d5-4f63-bc75-ee4a71f323e3 req-f0c12164-ce93-4aff-936c-801fc56d4b7f tempest-TestStampPattern-1741259215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '705ac61d-f2f2-4d8a-9a33-2b808e3a86a1', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:57:44 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-2182ac9b-36d5-4f63-bc75-ee4a71f323e3 req-f0c12164-ce93-4aff-936c-801fc56d4b7f tempest-TestStampPattern-1741259215 None] attachment_update completed successfully. Nov 05 03:57:44 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7ef7ce4f-62ff-4611-9a0e-afb7406a620e Nov 05 03:57:44 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:45 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c682e5cb-924e-4d1e-ad6d-87002d6f9639 tempest-TestMinimumBasicScenario-1694014871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7ef7ce4f-62ff-4611-9a0e-afb7406a620e" returned: 0 in 0.420s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c682e5cb-924e-4d1e-ad6d-87002d6f9639 tempest-TestMinimumBasicScenario-1694014871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7ef7ce4f-62ff-4611-9a0e-afb7406a620e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:45 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7ef7ce4f-62ff-4611-9a0e-afb7406a620e Nov 05 03:57:45 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:45 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c682e5cb-924e-4d1e-ad6d-87002d6f9639 tempest-TestMinimumBasicScenario-1694014871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7ef7ce4f-62ff-4611-9a0e-afb7406a620e" returned: 0 in 0.310s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c682e5cb-924e-4d1e-ad6d-87002d6f9639 tempest-TestMinimumBasicScenario-1694014871 None] Lock "cinder-quobyte-7ef7ce4f-62ff-4611-9a0e-afb7406a620e" released by "delete_volume" :: held 0.780s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:45 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-c682e5cb-924e-4d1e-ad6d-87002d6f9639 tempest-TestMinimumBasicScenario-1694014871 None] Created reservations ['fc11201b-62cd-4fa5-8e2a-d4e00aff033d', '166a4a83-2628-4b60-b2ef-ce5d0f4ce5ad', '8093be24-700e-426a-b0cc-c64b6a9c7a59', 'fdb75b30-2c0e-4770-a4ac-b873b2610f79'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:57:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c682e5cb-924e-4d1e-ad6d-87002d6f9639 tempest-TestMinimumBasicScenario-1694014871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c682e5cb-924e-4d1e-ad6d-87002d6f9639 tempest-TestMinimumBasicScenario-1694014871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:45 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c682e5cb-924e-4d1e-ad6d-87002d6f9639 tempest-TestMinimumBasicScenario-1694014871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:45 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c682e5cb-924e-4d1e-ad6d-87002d6f9639 tempest-TestMinimumBasicScenario-1694014871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c682e5cb-924e-4d1e-ad6d-87002d6f9639 tempest-TestMinimumBasicScenario-1694014871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c682e5cb-924e-4d1e-ad6d-87002d6f9639 tempest-TestMinimumBasicScenario-1694014871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:45 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:57:45 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:45 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c682e5cb-924e-4d1e-ad6d-87002d6f9639 tempest-TestMinimumBasicScenario-1694014871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.255s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:45 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-c682e5cb-924e-4d1e-ad6d-87002d6f9639 tempest-TestMinimumBasicScenario-1694014871 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:45 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-c682e5cb-924e-4d1e-ad6d-87002d6f9639 tempest-TestMinimumBasicScenario-1694014871 None] Deleted volume successfully. Nov 05 03:57:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c682e5cb-924e-4d1e-ad6d-87002d6f9639 tempest-TestMinimumBasicScenario-1694014871 None] Lock "cinder-7ef7ce4f-62ff-4611-9a0e-afb7406a620e-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:57:50 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-d9277924-5df8-4dc2-843c-b45f8a0139ee req-70340a3a-cee6-4d07-bad4-e98d27a1c493 tempest-TestStampPattern-1741259215 None] Terminate volume connection completed successfully. Nov 05 03:57:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-d9277924-5df8-4dc2-843c-b45f8a0139ee req-70340a3a-cee6-4d07-bad4-e98d27a1c493 tempest-TestStampPattern-1741259215 None] Deleting attachment 705ac61d-f2f2-4d8a-9a33-2b808e3a86a1. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:57:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-69b795c1-1853-4374-9c70-f0b80d0d8806 tempest-TestStampPattern-1741259215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-69b795c1-1853-4374-9c70-f0b80d0d8806 tempest-TestStampPattern-1741259215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-69b795c1-1853-4374-9c70-f0b80d0d8806 tempest-TestStampPattern-1741259215 None] Creating offline snapshot bcb7bfb1-a2c4-49d7-826e-93997774d38e of volume 81790c5f-9d9b-4114-8bf3-2baaa317eb45 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:57:51 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a1f93c-14cf-47dd-910e-eac32aa50207]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:57:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-69b795c1-1853-4374-9c70-f0b80d0d8806 tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:51 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 Nov 05 03:57:51 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:51 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-69b795c1-1853-4374-9c70-f0b80d0d8806 tempest-TestStampPattern-1741259215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45" returned: 0 in 0.393s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-69b795c1-1853-4374-9c70-f0b80d0d8806 tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:51 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e 1G Nov 05 03:57:51 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:52 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-69b795c1-1853-4374-9c70-f0b80d0d8806 tempest-TestStampPattern-1741259215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e 1G" returned: 0 in 0.452s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-69b795c1-1853-4374-9c70-f0b80d0d8806 tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:52 devstack sudo[104376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e Nov 05 03:57:52 devstack sudo[104376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:52 devstack sudo[104376]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-69b795c1-1853-4374-9c70-f0b80d0d8806 tempest-TestStampPattern-1741259215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e" returned: 0 in 0.280s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:52 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-69b795c1-1853-4374-9c70-f0b80d0d8806 tempest-TestStampPattern-1741259215 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e is being set with open permissions: ugo+rw Nov 05 03:57:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-69b795c1-1853-4374-9c70-f0b80d0d8806 tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:52 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e Nov 05 03:57:52 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:52 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-69b795c1-1853-4374-9c70-f0b80d0d8806 tempest-TestStampPattern-1741259215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e" returned: 0 in 0.243s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-69b795c1-1853-4374-9c70-f0b80d0d8806 tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:52 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.info Nov 05 03:57:52 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:52 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-69b795c1-1853-4374-9c70-f0b80d0d8806 tempest-TestStampPattern-1741259215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.info" returned: 0 in 0.317s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:52 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-69b795c1-1853-4374-9c70-f0b80d0d8806 tempest-TestStampPattern-1741259215 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.info is being set with open permissions: ugo+rw Nov 05 03:57:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-69b795c1-1853-4374-9c70-f0b80d0d8806 tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:52 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.info Nov 05 03:57:52 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:53 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-69b795c1-1853-4374-9c70-f0b80d0d8806 tempest-TestStampPattern-1741259215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.info" returned: 0 in 0.260s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-69b795c1-1853-4374-9c70-f0b80d0d8806 tempest-TestStampPattern-1741259215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.050s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:53 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-69b795c1-1853-4374-9c70-f0b80d0d8806 tempest-TestStampPattern-1741259215 None] Create snapshot completed successfully Nov 05 03:57:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:57:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:57:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:57:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:57:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:57:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:57:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:57:58 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:57:58 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:57:58 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Nov 05 03:57:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.258s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:57:58 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:57:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:57:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 28 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:57:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Flow 'volume_create_manager' (a2042748-0564-46d0-b822-8dc5a033e421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b123270d-ccfd-4577-9afc-77e36b7cc6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b123270d-ccfd-4577-9afc-77e36b7cc6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1179566899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d14bc996-53a7-4ee3-be00-346fe19ec79b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4c3e3c28f0e4d218543bfe11012ac5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bcb7bfb1-a2c4-49d7-826e-93997774d38e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:58:01Z,use_quota=True,user_id='4b33ea2218bb4982b2ad849bb2b922a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68276eff-0ba0-41a2-a445-40ae10fc70e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68276eff-0ba0-41a2-a445-40ae10fc70e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd291e7a-9d9f-4004-b120-9c8183f62a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd291e7a-9d9f-4004-b120-9c8183f62a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd14bc996-53a7-4ee3-be00-346fe19ec79b', 'volume_name': 'volume-d14bc996-53a7-4ee3-be00-346fe19ec79b', 'volume_size': 1, 'snapshot_id': 'bcb7bfb1-a2c4-49d7-826e-93997774d38e'}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc9b137-fa6d-4163-8a12-f9911d48612c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc9b137-fa6d-4163-8a12-f9911d48612c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a9b16b-5b4c-4e3c-bab9-7d104b19f40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:01 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Volume d14bc996-53a7-4ee3-be00-346fe19ec79b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d14bc996-53a7-4ee3-be00-346fe19ec79b', 'volume_size': 1, 'snapshot_id': 'bcb7bfb1-a2c4-49d7-826e-93997774d38e'} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Acquiring lock "cinder-quobyte-bcb7bfb1-a2c4-49d7-826e-93997774d38e-d14bc996-53a7-4ee3-be00-346fe19ec79b" by "_create_volume_from_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Lock "cinder-quobyte-bcb7bfb1-a2c4-49d7-826e-93997774d38e-d14bc996-53a7-4ee3-be00-346fe19ec79b" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Creating volume d14bc996-53a7-4ee3-be00-346fe19ec79b from snapshot bcb7bfb1-a2c4-49d7-826e-93997774d38e {{(pid=87109) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Acquiring lock "cinder-quobyte-d14bc996-53a7-4ee3-be00-346fe19ec79b" by "_copy_volume_from_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Lock "cinder-quobyte-d14bc996-53a7-4ee3-be00-346fe19ec79b" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] snapshot: bcb7bfb1-a2c4-49d7-826e-93997774d38e, volume: d14bc996-53a7-4ee3-be00-346fe19ec79b, {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ea6d09-80aa-42a1-b050-4f99f4234694]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:01 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e Nov 05 03:58:01 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:01 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e" returned: 0 in 0.481s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[641f0877-1973-462e-a650-ab931d229db5]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:58:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:01 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 Nov 05 03:58:01 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:02 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45" returned: 0 in 0.473s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:02 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 03:58:02 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Creating direct copy from snapshot {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 03:58:02 devstack cinder-volume[87109]: DEBUG cinder.utils [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Path /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d14bc996-53a7-4ee3-be00-346fe19ec79b not found in is_blk_device check {{(pid=87109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 03:58:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d14bc996-53a7-4ee3-be00-346fe19ec79b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:02 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d14bc996-53a7-4ee3-be00-346fe19ec79b Nov 05 03:58:02 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:10 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d14bc996-53a7-4ee3-be00-346fe19ec79b" returned: 0 in 8.250s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:10 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Image conversion details: src /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45, size 1024.00 MB, duration 8.25 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d14bc996-53a7-4ee3-be00-346fe19ec79b {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:58:10 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Converted 1024.00 MB image at 124.08 MB/s Nov 05 03:58:10 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d14bc996-53a7-4ee3-be00-346fe19ec79b is being set with open permissions: ugo+rw Nov 05 03:58:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d14bc996-53a7-4ee3-be00-346fe19ec79b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:10 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d14bc996-53a7-4ee3-be00-346fe19ec79b Nov 05 03:58:10 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:10 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d14bc996-53a7-4ee3-be00-346fe19ec79b" returned: 0 in 0.356s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Lock "cinder-quobyte-d14bc996-53a7-4ee3-be00-346fe19ec79b" released by "_copy_volume_from_snapshot" :: held 9.693s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:58:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Lock "cinder-quobyte-bcb7bfb1-a2c4-49d7-826e-93997774d38e-d14bc996-53a7-4ee3-be00-346fe19ec79b" released by "_create_volume_from_snapshot" :: held 9.792s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:58:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.826s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:58:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a9b16b-5b4c-4e3c-bab9-7d104b19f40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d14bc996-53a7-4ee3-be00-346fe19ec79b', 'volume_size': 1, 'snapshot_id': 'bcb7bfb1-a2c4-49d7-826e-93997774d38e'}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60c98ca-6d12-48a3-a791-5d3a4dd6dd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:11 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Volume volume-d14bc996-53a7-4ee3-be00-346fe19ec79b (d14bc996-53a7-4ee3-be00-346fe19ec79b): created successfully Nov 05 03:58:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60c98ca-6d12-48a3-a791-5d3a4dd6dd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Flow 'volume_create_manager' (a2042748-0564-46d0-b822-8dc5a033e421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:58:11 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-dec1db76-cb91-453d-811c-2f5d8d039482 tempest-TestStampPattern-1741259215 None] Created volume successfully. Nov 05 03:58:30 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=21,cinder:UPDATE=17,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:58:30 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=23,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:58:32 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:58:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Flow 'volume_create_manager' (ef3104a6-4640-4150-ba46-c4ab240c66cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:58:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b7bb9e-eaf7-4437-bd3a-e1809c7e0ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6b7bb9e-eaf7-4437-bd3a-e1809c7e0ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-701378943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e4d989f-0bfd-4647-a10b-703c87050c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4cfb52c4b0490bb4342e98443f9281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:58:33Z,use_quota=True,user_id='44ded5fa9768412ca9de36c21053161a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a71688-a4cb-4ef9-9721-cd49d4d00109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a71688-a4cb-4ef9-9721-cd49d4d00109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55706b4f-c82e-48cc-9908-b829f7a28e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:32 devstack cinder-volume[87109]: DEBUG cinder.image.glance [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Creating Keystone auth plugin from conf {{(pid=87109) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 03:58:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55706b4f-c82e-48cc-9908-b829f7a28e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5e4d989f-0bfd-4647-a10b-703c87050c9d', 'volume_name': 'volume-5e4d989f-0bfd-4647-a10b-703c87050c9d', 'volume_size': 1, 'image_id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9a2a266d3247698576f415a1551384', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a26becc9-e998-4acb-893a-f9b2cfa3a826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a26becc9-e998-4acb-893a-f9b2cfa3a826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fca139-c561-4f52-b36a-4a889da665ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:33 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Volume 5e4d989f-0bfd-4647-a10b-703c87050c9d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5e4d989f-0bfd-4647-a10b-703c87050c9d', 'volume_size': 1, 'image_id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9a2a266d3247698576f415a1551384', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 03:58:33 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Trying to clone 5e4d989f-0bfd-4647-a10b-703c87050c9d from image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}]). {{(pid=87109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 03:58:33 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_fem047_4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 05 03:58:33 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Image download 20.69 MB at 20.69 MB/s Nov 05 03:58:33 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a336c21-87f8-4cc6-ad2b-96c47f156522]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:58:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_fem047_4devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:33 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_fem047_4devstack@QuobyteHD Nov 05 03:58:33 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:33 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_fem047_4devstack@QuobyteHD" returned: 0 in 0.313s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:33 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Temporary image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 is fetched for user 44ded5fa9768412ca9de36c21053161a. {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 05 03:58:33 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eec1b2d-80fb-40f7-a360-ff1da23d71c0]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:58:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_fem047_4devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:34 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_fem047_4devstack@QuobyteHD Nov 05 03:58:34 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:34 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_fem047_4devstack@QuobyteHD" returned: 0 in 0.333s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:58:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:58:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-701378943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e4d989f-0bfd-4647-a10b-703c87050c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff4cfb52c4b0490bb4342e98443f9281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:58:33Z,use_quota=True,user_id='44ded5fa9768412ca9de36c21053161a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:58:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Creating volume 5e4d989f-0bfd-4647-a10b-703c87050c9d {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:58:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:58:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:58:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:58:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:58:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:58:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:58:34 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:58:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e4d989f-0bfd-4647-a10b-703c87050c9d 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:34 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e4d989f-0bfd-4647-a10b-703c87050c9d 1073741824 Nov 05 03:58:34 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:34 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e4d989f-0bfd-4647-a10b-703c87050c9d 1073741824" returned: 0 in 0.422s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e4d989f-0bfd-4647-a10b-703c87050c9d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:34 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e4d989f-0bfd-4647-a10b-703c87050c9d Nov 05 03:58:34 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:34 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e4d989f-0bfd-4647-a10b-703c87050c9d" returned: 0 in 0.246s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:58:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:58:34 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Attempting download of b71101b4-5e1f-4b78-90ce-ec8cda8c1237 ((None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}])) to volume 5e4d989f-0bfd-4647-a10b-703c87050c9d. {{(pid=87109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 05 03:58:35 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5f1c72-dc5c-4937-9b7d-cd2ebd4c5e0c]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:58:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_4g9q1rt9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:35 devstack sudo[104620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_4g9q1rt9 Nov 05 03:58:35 devstack sudo[104620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:35 devstack sudo[104620]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_4g9q1rt9" returned: 0 in 0.337s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_4g9q1rt9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:35 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_4g9q1rt9 Nov 05 03:58:35 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:35 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_4g9q1rt9" returned: 1 in 0.323s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_4g9q1rt9' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:58:35 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2528f303-6823-4226-9b4e-7d07627be6e2]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:58:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_fem047_4devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:35 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_fem047_4devstack@QuobyteHD Nov 05 03:58:35 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:36 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_fem047_4devstack@QuobyteHD" returned: 0 in 0.364s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:36 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] b71101b4-5e1f-4b78-90ce-ec8cda8c1237 was qcow2, converting to qcow2 {{(pid=87109) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 05 03:58:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_fem047_4devstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e4d989f-0bfd-4647-a10b-703c87050c9d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:36 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_fem047_4devstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e4d989f-0bfd-4647-a10b-703c87050c9d Nov 05 03:58:36 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:38 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_fem047_4devstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e4d989f-0bfd-4647-a10b-703c87050c9d" returned: 0 in 2.044s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:38 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b71101b4-5e1f-4b78-90ce-ec8cda8c1237_fem047_4devstack@QuobyteHD, size 112.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e4d989f-0bfd-4647-a10b-703c87050c9d {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:58:38 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Converted 112.00 MB image at 54.76 MB/s Nov 05 03:58:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e4d989f-0bfd-4647-a10b-703c87050c9d 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:38 devstack sudo[104642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e4d989f-0bfd-4647-a10b-703c87050c9d 1G Nov 05 03:58:38 devstack sudo[104642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:38 devstack sudo[104642]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e4d989f-0bfd-4647-a10b-703c87050c9d 1G" returned: 0 in 0.319s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:38 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Downloaded image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 ((None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}])) to volume 5e4d989f-0bfd-4647-a10b-703c87050c9d successfully. {{(pid=87109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 05 03:58:38 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Temporary image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 for user 44ded5fa9768412ca9de36c21053161a is deleted. {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 05 03:58:38 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Marking volume 5e4d989f-0bfd-4647-a10b-703c87050c9d as bootable. {{(pid=87109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 05 03:58:38 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Copying metadata from image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 to 5e4d989f-0bfd-4647-a10b-703c87050c9d. {{(pid=87109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 03:58:38 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Creating volume glance metadata for volume 5e4d989f-0bfd-4647-a10b-703c87050c9d backed by image b71101b4-5e1f-4b78-90ce-ec8cda8c1237 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 03:58:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34fca139-c561-4f52-b36a-4a889da665ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e4d989f-0bfd-4647-a10b-703c87050c9d', 'volume_size': 1, 'image_id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5c9a2a266d3247698576f415a1551384', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b71101b4-5e1f-4b78-90ce-ec8cda8c1237', 'created_at': datetime.datetime(2026, 11, 5, 2, 35, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 35, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b71101b4-5e1f-4b78-90ce-ec8cda8c1237/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1404ab-b45d-41ce-9539-870260b81448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:58:38 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Volume volume-5e4d989f-0bfd-4647-a10b-703c87050c9d (5e4d989f-0bfd-4647-a10b-703c87050c9d): created successfully Nov 05 03:58:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c1404ab-b45d-41ce-9539-870260b81448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:58:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Flow 'volume_create_manager' (ef3104a6-4640-4150-ba46-c4ab240c66cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:58:38 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-0f461042-1ecf-40ce-968c-c64e3486055d tempest-TestShelveInstance-402511666 None] Created volume successfully. Nov 05 03:58:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-876e67b5-d5cf-48d6-807d-49e4a80fa787 req-8fc3d42b-8c29-49b0-a926-1d3a4ba6ed57 tempest-TestShelveInstance-402511666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:58:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-876e67b5-d5cf-48d6-807d-49e4a80fa787 req-8fc3d42b-8c29-49b0-a926-1d3a4ba6ed57 tempest-TestShelveInstance-402511666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:58:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-876e67b5-d5cf-48d6-807d-49e4a80fa787 req-8fc3d42b-8c29-49b0-a926-1d3a4ba6ed57 tempest-TestShelveInstance-402511666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:58:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-876e67b5-d5cf-48d6-807d-49e4a80fa787 req-8fc3d42b-8c29-49b0-a926-1d3a4ba6ed57 tempest-TestShelveInstance-402511666 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-5e4d989f-0bfd-4647-a10b-703c87050c9d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8621700d-671f-4174-8783-ce11e7714406', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:58:41 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-876e67b5-d5cf-48d6-807d-49e4a80fa787 req-8fc3d42b-8c29-49b0-a926-1d3a4ba6ed57 tempest-TestShelveInstance-402511666 None] attachment_update completed successfully. Nov 05 03:58:51 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=17,cinder:INSERT=4,cinder:UPDATE=8 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:58:51 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=15,cinder:UPDATE=4,cinder:INSERT=10,cinder:DELETE=1 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:58:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-5043d091-f1cc-4878-b12b-70bf3a30bf77 req-962351e9-6b8b-4867-b3bb-260f245ee680 tempest-TestStampPattern-1741259215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:58:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-5043d091-f1cc-4878-b12b-70bf3a30bf77 req-962351e9-6b8b-4867-b3bb-260f245ee680 tempest-TestStampPattern-1741259215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:58:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-5043d091-f1cc-4878-b12b-70bf3a30bf77 req-962351e9-6b8b-4867-b3bb-260f245ee680 tempest-TestStampPattern-1741259215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:58:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-5043d091-f1cc-4878-b12b-70bf3a30bf77 req-962351e9-6b8b-4867-b3bb-260f245ee680 tempest-TestStampPattern-1741259215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-d14bc996-53a7-4ee3-be00-346fe19ec79b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9adc8ce-1356-4250-9b8d-ff948de847cc', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:58:53 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-5043d091-f1cc-4878-b12b-70bf3a30bf77 req-962351e9-6b8b-4867-b3bb-260f245ee680 tempest-TestStampPattern-1741259215 None] attachment_update completed successfully. Nov 05 03:58:55 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-f28de65f-e34b-431b-814e-01840f6eb6b0 req-cabc7f70-f5f8-4f1d-815a-84074a662f5b tempest-TestStampPattern-1741259215 None] Terminate volume connection completed successfully. Nov 05 03:58:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-f28de65f-e34b-431b-814e-01840f6eb6b0 req-cabc7f70-f5f8-4f1d-815a-84074a662f5b tempest-TestStampPattern-1741259215 None] Deleting attachment d9adc8ce-1356-4250-9b8d-ff948de847cc. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:58:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:58:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:58:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:58:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:58:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:58:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:58:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:58:58 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:58:58 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:58:58 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Nov 05 03:58:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.304s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:58:58 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:58:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:58:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 28 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:58:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 03:58:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1b07b5b6-8583-44b4-8659-4fe94ed9e240 tempest-TestStampPattern-1741259215 None] Acquiring lock "cinder-d14bc996-53a7-4ee3-be00-346fe19ec79b-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1b07b5b6-8583-44b4-8659-4fe94ed9e240 tempest-TestStampPattern-1741259215 None] Lock "cinder-d14bc996-53a7-4ee3-be00-346fe19ec79b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1b07b5b6-8583-44b4-8659-4fe94ed9e240 tempest-TestStampPattern-1741259215 None] Acquiring lock "cinder-quobyte-d14bc996-53a7-4ee3-be00-346fe19ec79b" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:58:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1b07b5b6-8583-44b4-8659-4fe94ed9e240 tempest-TestStampPattern-1741259215 None] Lock "cinder-quobyte-d14bc996-53a7-4ee3-be00-346fe19ec79b" acquired by "delete_volume" :: waited 0.020s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:58:59 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[087dc735-c726-4802-8579-bd878664464e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:58:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1b07b5b6-8583-44b4-8659-4fe94ed9e240 tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d14bc996-53a7-4ee3-be00-346fe19ec79b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:00 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d14bc996-53a7-4ee3-be00-346fe19ec79b Nov 05 03:59:00 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:00 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1b07b5b6-8583-44b4-8659-4fe94ed9e240 tempest-TestStampPattern-1741259215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d14bc996-53a7-4ee3-be00-346fe19ec79b" returned: 0 in 0.408s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1b07b5b6-8583-44b4-8659-4fe94ed9e240 tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d14bc996-53a7-4ee3-be00-346fe19ec79b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:00 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d14bc996-53a7-4ee3-be00-346fe19ec79b Nov 05 03:59:00 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:00 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1b07b5b6-8583-44b4-8659-4fe94ed9e240 tempest-TestStampPattern-1741259215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-d14bc996-53a7-4ee3-be00-346fe19ec79b" returned: 0 in 0.277s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1b07b5b6-8583-44b4-8659-4fe94ed9e240 tempest-TestStampPattern-1741259215 None] Lock "cinder-quobyte-d14bc996-53a7-4ee3-be00-346fe19ec79b" released by "delete_volume" :: held 0.735s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:59:00 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-1b07b5b6-8583-44b4-8659-4fe94ed9e240 tempest-TestStampPattern-1741259215 None] Created reservations ['a228bb7d-fa2a-42ec-a04b-2fa7dacd1f25', 'df53c3f4-7f5f-4a5c-83c3-4a1b0dfc160f', '33a3c594-64ad-4269-bd1d-e103cd4731a8', '56d8cede-eaee-4778-92da-c1b57a822fc1'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:59:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1b07b5b6-8583-44b4-8659-4fe94ed9e240 tempest-TestStampPattern-1741259215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1b07b5b6-8583-44b4-8659-4fe94ed9e240 tempest-TestStampPattern-1741259215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1b07b5b6-8583-44b4-8659-4fe94ed9e240 tempest-TestStampPattern-1741259215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:59:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1b07b5b6-8583-44b4-8659-4fe94ed9e240 tempest-TestStampPattern-1741259215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:59:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1b07b5b6-8583-44b4-8659-4fe94ed9e240 tempest-TestStampPattern-1741259215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1b07b5b6-8583-44b4-8659-4fe94ed9e240 tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:00 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:59:00 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:01 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1b07b5b6-8583-44b4-8659-4fe94ed9e240 tempest-TestStampPattern-1741259215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.312s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:01 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-1b07b5b6-8583-44b4-8659-4fe94ed9e240 tempest-TestStampPattern-1741259215 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:59:01 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-1b07b5b6-8583-44b4-8659-4fe94ed9e240 tempest-TestStampPattern-1741259215 None] Deleted volume successfully. Nov 05 03:59:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1b07b5b6-8583-44b4-8659-4fe94ed9e240 tempest-TestStampPattern-1741259215 None] Lock "cinder-d14bc996-53a7-4ee3-be00-346fe19ec79b-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:59:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] Acquiring lock "cinder-bcb7bfb1-a2c4-49d7-826e-93997774d38e-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:59:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] Lock "cinder-bcb7bfb1-a2c4-49d7-826e-93997774d38e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:59:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] Acquiring lock "cinder-quobyte-81790c5f-9d9b-4114-8bf3-2baaa317eb45" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:59:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] Lock "cinder-quobyte-81790c5f-9d9b-4114-8bf3-2baaa317eb45" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:59:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] Acquiring lock "cinder-quobyte-bcb7bfb1-a2c4-49d7-826e-93997774d38e" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:59:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] Lock "cinder-quobyte-bcb7bfb1-a2c4-49d7-826e-93997774d38e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:59:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] Deleting offline snapshot bcb7bfb1-a2c4-49d7-826e-93997774d38e of volume 81790c5f-9d9b-4114-8bf3-2baaa317eb45 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:59:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] snapshot_file for this snap is: volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:59:01 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd0ed89-6ffb-4e67-b0c6-95dd8a296ebd]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:59:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:01 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e Nov 05 03:59:01 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:01 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e" returned: 0 in 0.360s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:59:01 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab26f88d-0e45-4e43-bee9-39ba25a1db40]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:59:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:01 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 Nov 05 03:59:01 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:02 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45" returned: 0 in 0.506s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:02 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e Nov 05 03:59:02 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:02 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e" returned: 0 in 0.306s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:02 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e Nov 05 03:59:02 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:02 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45.bcb7bfb1-a2c4-49d7-826e-93997774d38e" returned: 0 in 0.226s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:02 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] Lock "cinder-quobyte-bcb7bfb1-a2c4-49d7-826e-93997774d38e" released by "_delete_snapshot" :: held 1.500s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:59:02 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] Lock "cinder-quobyte-81790c5f-9d9b-4114-8bf3-2baaa317eb45" released by "delete_snapshot" :: held 1.522s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:59:02 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] Created reservations ['11a020bd-0bd5-4588-ae2c-d79dd41b7c72', 'c7ada9b1-cbe8-4258-9688-26304c6b2479', 'd4905134-e7ae-4ab5-8ef7-c66bbeac5454', '39418652-a0b8-4bd6-b53d-1e2f3bd8e8c8'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:59:03 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] Delete snapshot completed successfully. Nov 05 03:59:03 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d00e2024-b803-4bf3-9f5c-080baef85cbf tempest-TestStampPattern-1741259215 None] Lock "cinder-bcb7bfb1-a2c4-49d7-826e-93997774d38e-delete_snapshot" released by "delete_snapshot" :: held 1.651s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:59:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a05ea9e2-f567-4c50-95e4-296232b6df20 tempest-TestStampPattern-1741259215 None] Acquiring lock "cinder-81790c5f-9d9b-4114-8bf3-2baaa317eb45-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:59:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a05ea9e2-f567-4c50-95e4-296232b6df20 tempest-TestStampPattern-1741259215 None] Lock "cinder-81790c5f-9d9b-4114-8bf3-2baaa317eb45-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:59:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a05ea9e2-f567-4c50-95e4-296232b6df20 tempest-TestStampPattern-1741259215 None] Acquiring lock "cinder-quobyte-81790c5f-9d9b-4114-8bf3-2baaa317eb45" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:59:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a05ea9e2-f567-4c50-95e4-296232b6df20 tempest-TestStampPattern-1741259215 None] Lock "cinder-quobyte-81790c5f-9d9b-4114-8bf3-2baaa317eb45" acquired by "delete_volume" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:59:06 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0549de-a641-4409-9d07-cd5de859e625]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:59:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a05ea9e2-f567-4c50-95e4-296232b6df20 tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:06 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 Nov 05 03:59:06 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:06 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a05ea9e2-f567-4c50-95e4-296232b6df20 tempest-TestStampPattern-1741259215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45" returned: 0 in 0.360s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a05ea9e2-f567-4c50-95e4-296232b6df20 tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:06 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45 Nov 05 03:59:06 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:07 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a05ea9e2-f567-4c50-95e4-296232b6df20 tempest-TestStampPattern-1741259215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-81790c5f-9d9b-4114-8bf3-2baaa317eb45" returned: 0 in 0.244s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:07 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a05ea9e2-f567-4c50-95e4-296232b6df20 tempest-TestStampPattern-1741259215 None] Lock "cinder-quobyte-81790c5f-9d9b-4114-8bf3-2baaa317eb45" released by "delete_volume" :: held 0.674s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:59:07 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-a05ea9e2-f567-4c50-95e4-296232b6df20 tempest-TestStampPattern-1741259215 None] Created reservations ['6e7fa215-b57f-4481-901f-a062742d3d32', '1a7e702f-5c26-4ce6-8f9c-c7e543c75655', 'f5f38dc7-af79-4a2a-9b43-5e2bdcaef3b3', '5f773de9-3ab6-4819-9885-65d3e627e33f'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:59:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a05ea9e2-f567-4c50-95e4-296232b6df20 tempest-TestStampPattern-1741259215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a05ea9e2-f567-4c50-95e4-296232b6df20 tempest-TestStampPattern-1741259215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:07 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a05ea9e2-f567-4c50-95e4-296232b6df20 tempest-TestStampPattern-1741259215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:59:07 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a05ea9e2-f567-4c50-95e4-296232b6df20 tempest-TestStampPattern-1741259215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:59:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a05ea9e2-f567-4c50-95e4-296232b6df20 tempest-TestStampPattern-1741259215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a05ea9e2-f567-4c50-95e4-296232b6df20 tempest-TestStampPattern-1741259215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:07 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:59:07 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:07 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a05ea9e2-f567-4c50-95e4-296232b6df20 tempest-TestStampPattern-1741259215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.301s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:07 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-a05ea9e2-f567-4c50-95e4-296232b6df20 tempest-TestStampPattern-1741259215 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:59:07 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-a05ea9e2-f567-4c50-95e4-296232b6df20 tempest-TestStampPattern-1741259215 None] Deleted volume successfully. Nov 05 03:59:07 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a05ea9e2-f567-4c50-95e4-296232b6df20 tempest-TestStampPattern-1741259215 None] Lock "cinder-81790c5f-9d9b-4114-8bf3-2baaa317eb45-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:59:11 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-c395c8db-b1c6-40d4-a1fa-637ad8957e11 req-4157a056-1833-42fc-a337-837e0bdc8e24 tempest-TestShelveInstance-402511666 None] Terminate volume connection completed successfully. Nov 05 03:59:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-c395c8db-b1c6-40d4-a1fa-637ad8957e11 req-4157a056-1833-42fc-a337-837e0bdc8e24 tempest-TestShelveInstance-402511666 None] Deleting attachment 8621700d-671f-4174-8783-ce11e7714406. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:59:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-3602cd7b-d503-449b-b324-ef72f4e87a1d req-30c30865-e774-437e-b0fb-8aafa9b75756 tempest-TestShelveInstance-402511666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-3602cd7b-d503-449b-b324-ef72f4e87a1d req-30c30865-e774-437e-b0fb-8aafa9b75756 tempest-TestShelveInstance-402511666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-3602cd7b-d503-449b-b324-ef72f4e87a1d req-30c30865-e774-437e-b0fb-8aafa9b75756 tempest-TestShelveInstance-402511666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-3602cd7b-d503-449b-b324-ef72f4e87a1d req-30c30865-e774-437e-b0fb-8aafa9b75756 tempest-TestShelveInstance-402511666 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9', 'name': 'volume-5e4d989f-0bfd-4647-a10b-703c87050c9d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c391b58-c4a5-470d-afaf-96fc26b4b661', 'enforce_multipath': True} {{(pid=87109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4945}} Nov 05 03:59:13 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-3602cd7b-d503-449b-b324-ef72f4e87a1d req-30c30865-e774-437e-b0fb-8aafa9b75756 tempest-TestShelveInstance-402511666 None] attachment_update completed successfully. Nov 05 03:59:23 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=34,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:59:23 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=31,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 03:59:24 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:59:24 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Flow 'volume_create_manager' (c8cd77e9-dc9a-4191-b8d5-5236970de3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:59:24 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c64fe1-32b7-497d-a905-4470e1aa8f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:24 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13c64fe1-32b7-497d-a905-4470e1aa8f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c807c5b-f780-4d68-a230-b7ad4cfb8ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910c7f21466f498280c0ebd11a75582f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:24Z,use_quota=True,user_id='9008a90b303441bcb5bf64a3a522b551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:24 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8e5429-86a4-495f-8250-932fb9bd7ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:24 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8e5429-86a4-495f-8250-932fb9bd7ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:24 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449b4ac0-6235-4a26-af40-354884e08b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:24 devstack cinder-volume[87109]: DEBUG cinder.image.glance [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Creating Keystone auth plugin from conf {{(pid=87109) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 03:59:24 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449b4ac0-6235-4a26-af40-354884e08b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6c807c5b-f780-4d68-a230-b7ad4cfb8ef1', 'volume_name': 'volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1', 'volume_size': 1, 'image_id': 'c5581314-1a65-46ba-a60d-a5510e35b8b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5581314-1a65-46ba-a60d-a5510e35b8b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a4b4dcbd6c4497c5e6b71a796bf738f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '910c7f21466f498280c0ebd11a75582f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd40a856884c1e9ac091aacf10dfa3459119b227e00af41e5fec4e1f3170cef30419103f7eb452b95c7c336a6fb889483fc3313957cf346d4cc7c10c8153d60e9', 'id': 'c5581314-1a65-46ba-a60d-a5510e35b8b1', 'created_at': datetime.datetime(2026, 11, 5, 2, 59, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 59, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5581314-1a65-46ba-a60d-a5510e35b8b1/file', 'properties': {}}, 'image_service': }' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:24 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605d4eac-d4c1-4e6e-9dfd-556d7d451c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:24 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605d4eac-d4c1-4e6e-9dfd-556d7d451c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:24 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf50e54-a378-4aac-993f-41b0a466fdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:24 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Volume 6c807c5b-f780-4d68-a230-b7ad4cfb8ef1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1', 'volume_size': 1, 'image_id': 'c5581314-1a65-46ba-a60d-a5510e35b8b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5581314-1a65-46ba-a60d-a5510e35b8b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a4b4dcbd6c4497c5e6b71a796bf738f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '910c7f21466f498280c0ebd11a75582f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd40a856884c1e9ac091aacf10dfa3459119b227e00af41e5fec4e1f3170cef30419103f7eb452b95c7c336a6fb889483fc3313957cf346d4cc7c10c8153d60e9', 'id': 'c5581314-1a65-46ba-a60d-a5510e35b8b1', 'created_at': datetime.datetime(2026, 11, 5, 2, 59, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 59, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5581314-1a65-46ba-a60d-a5510e35b8b1/file', 'properties': {}}, 'image_service': } Nov 05 03:59:24 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Trying to clone 6c807c5b-f780-4d68-a230-b7ad4cfb8ef1 from image c5581314-1a65-46ba-a60d-a5510e35b8b1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c5581314-1a65-46ba-a60d-a5510e35b8b1', 'metadata': {}}]). {{(pid=87109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 03:59:24 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 05 03:59:24 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Image download 0.00 MB at 0.00 MB/s Nov 05 03:59:24 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[35955e8f-80a2-4e85-9159-003f34974608]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:59:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:24 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD Nov 05 03:59:24 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:25 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:25 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD Nov 05 03:59:25 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:25 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD" returned: 1 in 0.380s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:59:25 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Temporary image c5581314-1a65-46ba-a60d-a5510e35b8b1 is fetched for user 9008a90b303441bcb5bf64a3a522b551. {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 05 03:59:25 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37fd98c-b6b4-4081-b2db-e6952450eccd]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:59:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:25 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD Nov 05 03:59:25 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:26 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD" returned: 0 in 0.432s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:26 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD Nov 05 03:59:26 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:26 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD" returned: 1 in 0.428s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:59:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c807c5b-f780-4d68-a230-b7ad4cfb8ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910c7f21466f498280c0ebd11a75582f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:24Z,use_quota=True,user_id='9008a90b303441bcb5bf64a3a522b551',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:59:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Creating volume 6c807c5b-f780-4d68-a230-b7ad4cfb8ef1 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:59:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:59:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:59:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:59:26 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:59:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:26 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1 1073741824 Nov 05 03:59:26 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:27 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1 1073741824" returned: 0 in 0.479s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:27 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1 Nov 05 03:59:27 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:27 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1" returned: 0 in 0.261s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:27 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:59:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:27 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Attempting download of c5581314-1a65-46ba-a60d-a5510e35b8b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5581314-1a65-46ba-a60d-a5510e35b8b1', 'metadata': {}}])) to volume 6c807c5b-f780-4d68-a230-b7ad4cfb8ef1. {{(pid=87109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 05 03:59:27 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[71248bac-9c35-45da-bed0-22bbe158202c]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:59:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5581314-1a65-46ba-a60d-a5510e35b8b1_6as0wmri {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:27 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5581314-1a65-46ba-a60d-a5510e35b8b1_6as0wmri Nov 05 03:59:27 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:27 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5581314-1a65-46ba-a60d-a5510e35b8b1_6as0wmri" returned: 0 in 0.383s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5581314-1a65-46ba-a60d-a5510e35b8b1_6as0wmri {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:27 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5581314-1a65-46ba-a60d-a5510e35b8b1_6as0wmri Nov 05 03:59:27 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:28 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5581314-1a65-46ba-a60d-a5510e35b8b1_6as0wmri" returned: 1 in 0.360s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5581314-1a65-46ba-a60d-a5510e35b8b1_6as0wmri' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:59:28 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e2b12d-052d-4fc3-8779-199323dff4a7]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:59:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:28 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD Nov 05 03:59:28 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:28 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:28 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD Nov 05 03:59:28 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:28 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD" returned: 1 in 0.408s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 03:59:28 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] c5581314-1a65-46ba-a60d-a5510e35b8b1 was raw, converting to qcow2 {{(pid=87109) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 05 03:59:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:28 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1 Nov 05 03:59:28 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:29 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1" returned: 0 in 0.551s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:29 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5581314-1a65-46ba-a60d-a5510e35b8b1_59wl4144devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1 {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 03:59:29 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 03:59:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:29 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1 1G Nov 05 03:59:29 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:29 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1 1G" returned: 0 in 0.405s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:29 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Downloaded image c5581314-1a65-46ba-a60d-a5510e35b8b1 ((None, [{'url': 'file:///opt/stack/data/glance/images/c5581314-1a65-46ba-a60d-a5510e35b8b1', 'metadata': {}}])) to volume 6c807c5b-f780-4d68-a230-b7ad4cfb8ef1 successfully. {{(pid=87109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 05 03:59:29 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Temporary image c5581314-1a65-46ba-a60d-a5510e35b8b1 for user 9008a90b303441bcb5bf64a3a522b551 is deleted. {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 05 03:59:29 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Marking volume 6c807c5b-f780-4d68-a230-b7ad4cfb8ef1 as bootable. {{(pid=87109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 05 03:59:29 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Copying metadata from image c5581314-1a65-46ba-a60d-a5510e35b8b1 to 6c807c5b-f780-4d68-a230-b7ad4cfb8ef1. {{(pid=87109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 03:59:29 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Creating volume glance metadata for volume 6c807c5b-f780-4d68-a230-b7ad4cfb8ef1 backed by image c5581314-1a65-46ba-a60d-a5510e35b8b1 with: {'image_id': 'c5581314-1a65-46ba-a60d-a5510e35b8b1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8a4b4dcbd6c4497c5e6b71a796bf738f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 03:59:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf50e54-a378-4aac-993f-41b0a466fdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1', 'volume_size': 1, 'image_id': 'c5581314-1a65-46ba-a60d-a5510e35b8b1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5581314-1a65-46ba-a60d-a5510e35b8b1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8a4b4dcbd6c4497c5e6b71a796bf738f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '910c7f21466f498280c0ebd11a75582f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd40a856884c1e9ac091aacf10dfa3459119b227e00af41e5fec4e1f3170cef30419103f7eb452b95c7c336a6fb889483fc3313957cf346d4cc7c10c8153d60e9', 'id': 'c5581314-1a65-46ba-a60d-a5510e35b8b1', 'created_at': datetime.datetime(2026, 11, 5, 2, 59, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 2, 59, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5581314-1a65-46ba-a60d-a5510e35b8b1/file', 'properties': {}}, 'image_service': }' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87324be0-fc86-4099-9880-402e64c7c6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:30 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Volume volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1 (6c807c5b-f780-4d68-a230-b7ad4cfb8ef1): created successfully Nov 05 03:59:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87324be0-fc86-4099-9880-402e64c7c6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Flow 'volume_create_manager' (c8cd77e9-dc9a-4191-b8d5-5236970de3e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:59:30 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-6cfb3a41-11f8-4ccd-8c6a-d11d4717e3b6 tempest-VolumeImageDependencyTests-163538323 None] Created volume successfully. Nov 05 03:59:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-43ef0802-b3b2-46a1-b974-0eeeec788a90 tempest-VolumeImageDependencyTests-163538323 None] Acquiring lock "cinder-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:59:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-43ef0802-b3b2-46a1-b974-0eeeec788a90 tempest-VolumeImageDependencyTests-163538323 None] Lock "cinder-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:59:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-43ef0802-b3b2-46a1-b974-0eeeec788a90 tempest-VolumeImageDependencyTests-163538323 None] Acquiring lock "cinder-quobyte-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:59:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-43ef0802-b3b2-46a1-b974-0eeeec788a90 tempest-VolumeImageDependencyTests-163538323 None] Lock "cinder-quobyte-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1" acquired by "delete_volume" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:59:31 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cb6376-c09c-4bd8-83a7-dc60db77b0ac]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:59:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-43ef0802-b3b2-46a1-b974-0eeeec788a90 tempest-VolumeImageDependencyTests-163538323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:31 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1 Nov 05 03:59:31 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:31 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-43ef0802-b3b2-46a1-b974-0eeeec788a90 tempest-VolumeImageDependencyTests-163538323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1" returned: 0 in 0.434s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-43ef0802-b3b2-46a1-b974-0eeeec788a90 tempest-VolumeImageDependencyTests-163538323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:31 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1 Nov 05 03:59:31 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:31 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-43ef0802-b3b2-46a1-b974-0eeeec788a90 tempest-VolumeImageDependencyTests-163538323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1" returned: 0 in 0.307s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-43ef0802-b3b2-46a1-b974-0eeeec788a90 tempest-VolumeImageDependencyTests-163538323 None] Lock "cinder-quobyte-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1" released by "delete_volume" :: held 0.791s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:59:31 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-43ef0802-b3b2-46a1-b974-0eeeec788a90 tempest-VolumeImageDependencyTests-163538323 None] Created reservations ['a2b96211-c5e4-4e8f-9424-efa62029490b', '4944aae7-77e8-4482-b963-44d8948f971f', 'bf865cd5-a5c2-4605-9780-cb831cf5f307', '9fef11ee-c360-4a4b-a65b-c9e18fc926e7'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:59:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-43ef0802-b3b2-46a1-b974-0eeeec788a90 tempest-VolumeImageDependencyTests-163538323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-43ef0802-b3b2-46a1-b974-0eeeec788a90 tempest-VolumeImageDependencyTests-163538323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-43ef0802-b3b2-46a1-b974-0eeeec788a90 tempest-VolumeImageDependencyTests-163538323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:59:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-43ef0802-b3b2-46a1-b974-0eeeec788a90 tempest-VolumeImageDependencyTests-163538323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:59:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-43ef0802-b3b2-46a1-b974-0eeeec788a90 tempest-VolumeImageDependencyTests-163538323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-43ef0802-b3b2-46a1-b974-0eeeec788a90 tempest-VolumeImageDependencyTests-163538323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:32 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:59:32 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:32 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-43ef0802-b3b2-46a1-b974-0eeeec788a90 tempest-VolumeImageDependencyTests-163538323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.323s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:32 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-43ef0802-b3b2-46a1-b974-0eeeec788a90 tempest-VolumeImageDependencyTests-163538323 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:59:32 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-43ef0802-b3b2-46a1-b974-0eeeec788a90 tempest-VolumeImageDependencyTests-163538323 None] Deleted volume successfully. Nov 05 03:59:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-43ef0802-b3b2-46a1-b974-0eeeec788a90 tempest-VolumeImageDependencyTests-163538323 None] Lock "cinder-6c807c5b-f780-4d68-a230-b7ad4cfb8ef1-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Flow 'volume_create_manager' (b2f9d6c1-ed1f-4d29-8f80-9160a6dd47f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1205ac7e-3c47-4b0c-97ac-f6123b0ed613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1205ac7e-3c47-4b0c-97ac-f6123b0ed613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e80cf02-a923-41aa-936b-2ab67fb347a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56cdb5153bec4a2f9a4c9690fd3109fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:36Z,use_quota=True,user_id='8b61db8abd924feab651bbec2a03ee7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (770267da-c573-4f44-bfc5-542250dc0f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (770267da-c573-4f44-bfc5-542250dc0f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d06493c-ce56-4b5d-974e-5488d4e030d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d06493c-ce56-4b5d-974e-5488d4e030d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e80cf02-a923-41aa-936b-2ab67fb347a7', 'volume_name': 'volume-5e80cf02-a923-41aa-936b-2ab67fb347a7', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da47ffb-8a2c-4299-944d-558313df167a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4da47ffb-8a2c-4299-944d-558313df167a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bade4b-28b2-49a0-9513-1a375a1ee968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:35 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Volume 5e80cf02-a923-41aa-936b-2ab67fb347a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e80cf02-a923-41aa-936b-2ab67fb347a7', 'volume_size': 1} Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e80cf02-a923-41aa-936b-2ab67fb347a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56cdb5153bec4a2f9a4c9690fd3109fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:36Z,use_quota=True,user_id='8b61db8abd924feab651bbec2a03ee7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Creating volume 5e80cf02-a923-41aa-936b-2ab67fb347a7 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:59:35 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:59:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e80cf02-a923-41aa-936b-2ab67fb347a7 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:35 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e80cf02-a923-41aa-936b-2ab67fb347a7 1073741824 Nov 05 03:59:35 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:36 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e80cf02-a923-41aa-936b-2ab67fb347a7 1073741824" returned: 0 in 0.470s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e80cf02-a923-41aa-936b-2ab67fb347a7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:36 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e80cf02-a923-41aa-936b-2ab67fb347a7 Nov 05 03:59:36 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:36 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e80cf02-a923-41aa-936b-2ab67fb347a7" returned: 0 in 0.258s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:59:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bade4b-28b2-49a0-9513-1a375a1ee968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e80cf02-a923-41aa-936b-2ab67fb347a7', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35bf2ad2-c531-46e9-bc9c-20e08d138ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:36 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Volume volume-5e80cf02-a923-41aa-936b-2ab67fb347a7 (5e80cf02-a923-41aa-936b-2ab67fb347a7): created successfully Nov 05 03:59:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35bf2ad2-c531-46e9-bc9c-20e08d138ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Flow 'volume_create_manager' (b2f9d6c1-ed1f-4d29-8f80-9160a6dd47f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:59:36 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-a5439a25-ec49-4e05-a793-de4fdf9893d6 tempest-CinderUnicodeTest-1022596496 None] Created volume successfully. Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Flow 'volume_create_manager' (b821eccc-e649-4f99-8604-12e269d04466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b3ec16-fa1d-485c-be0e-92eda9c1646f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b3ec16-fa1d-485c-be0e-92eda9c1646f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:59:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-598140933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66a95c25-56c0-465f-bfa0-c0136ef620dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56cdb5153bec4a2f9a4c9690fd3109fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:38Z,use_quota=True,user_id='8b61db8abd924feab651bbec2a03ee7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (474f6215-a88b-46fd-ade2-e1bc244d0a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (474f6215-a88b-46fd-ade2-e1bc244d0a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a466b629-b4d1-4722-aea0-2b799b5f41fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a466b629-b4d1-4722-aea0-2b799b5f41fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66a95c25-56c0-465f-bfa0-c0136ef620dd', 'volume_name': 'volume-66a95c25-56c0-465f-bfa0-c0136ef620dd', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262d7866-fec3-4c81-9320-657fbcf98a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262d7866-fec3-4c81-9320-657fbcf98a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1348323-f58a-483d-94d9-0b5a4fc09ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:38 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Volume 66a95c25-56c0-465f-bfa0-c0136ef620dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66a95c25-56c0-465f-bfa0-c0136ef620dd', 'volume_size': 1} Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T02:59:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-598140933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66a95c25-56c0-465f-bfa0-c0136ef620dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56cdb5153bec4a2f9a4c9690fd3109fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T02:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T02:59:38Z,use_quota=True,user_id='8b61db8abd924feab651bbec2a03ee7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Creating volume 66a95c25-56c0-465f-bfa0-c0136ef620dd {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 03:59:38 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 03:59:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:38 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd 1073741824 Nov 05 03:59:38 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:39 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd 1073741824" returned: 0 in 0.469s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:39 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd Nov 05 03:59:39 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:39 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd" returned: 0 in 0.276s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 03:59:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:39 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1348323-f58a-483d-94d9-0b5a4fc09ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66a95c25-56c0-465f-bfa0-c0136ef620dd', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:39 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cef7dd6-8bd0-43fa-ae78-0951ff696e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 03:59:39 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Volume volume-66a95c25-56c0-465f-bfa0-c0136ef620dd (66a95c25-56c0-465f-bfa0-c0136ef620dd): created successfully Nov 05 03:59:39 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cef7dd6-8bd0-43fa-ae78-0951ff696e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 03:59:39 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Flow 'volume_create_manager' (b821eccc-e649-4f99-8604-12e269d04466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 03:59:39 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f17b78e1-99b5-46e8-a5b8-1673a70aedf2 tempest-CinderUnicodeTest-1022596496 None] Created volume successfully. Nov 05 03:59:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3b80a042-e1c9-4609-a3b7-61699f38c632 tempest-CinderUnicodeTest-1022596496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3b80a042-e1c9-4609-a3b7-61699f38c632 tempest-CinderUnicodeTest-1022596496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:40 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-3b80a042-e1c9-4609-a3b7-61699f38c632 tempest-CinderUnicodeTest-1022596496 None] Creating offline snapshot dc2cc628-4119-4eef-9317-3b36fd4be9e2 of volume 66a95c25-56c0-465f-bfa0-c0136ef620dd {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 03:59:40 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e610739-50ed-4146-8d76-8787f705fa7b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:59:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3b80a042-e1c9-4609-a3b7-61699f38c632 tempest-CinderUnicodeTest-1022596496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:40 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd Nov 05 03:59:40 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:41 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3b80a042-e1c9-4609-a3b7-61699f38c632 tempest-CinderUnicodeTest-1022596496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd" returned: 0 in 0.437s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3b80a042-e1c9-4609-a3b7-61699f38c632 tempest-CinderUnicodeTest-1022596496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.dc2cc628-4119-4eef-9317-3b36fd4be9e2 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:41 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.dc2cc628-4119-4eef-9317-3b36fd4be9e2 1G Nov 05 03:59:41 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:41 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3b80a042-e1c9-4609-a3b7-61699f38c632 tempest-CinderUnicodeTest-1022596496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.dc2cc628-4119-4eef-9317-3b36fd4be9e2 1G" returned: 0 in 0.494s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3b80a042-e1c9-4609-a3b7-61699f38c632 tempest-CinderUnicodeTest-1022596496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66a95c25-56c0-465f-bfa0-c0136ef620dd -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.dc2cc628-4119-4eef-9317-3b36fd4be9e2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:41 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66a95c25-56c0-465f-bfa0-c0136ef620dd -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.dc2cc628-4119-4eef-9317-3b36fd4be9e2 Nov 05 03:59:41 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:42 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3b80a042-e1c9-4609-a3b7-61699f38c632 tempest-CinderUnicodeTest-1022596496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66a95c25-56c0-465f-bfa0-c0136ef620dd -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.dc2cc628-4119-4eef-9317-3b36fd4be9e2" returned: 0 in 0.316s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:42 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-3b80a042-e1c9-4609-a3b7-61699f38c632 tempest-CinderUnicodeTest-1022596496 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.dc2cc628-4119-4eef-9317-3b36fd4be9e2 is being set with open permissions: ugo+rw Nov 05 03:59:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3b80a042-e1c9-4609-a3b7-61699f38c632 tempest-CinderUnicodeTest-1022596496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.dc2cc628-4119-4eef-9317-3b36fd4be9e2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:42 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.dc2cc628-4119-4eef-9317-3b36fd4be9e2 Nov 05 03:59:42 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:42 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3b80a042-e1c9-4609-a3b7-61699f38c632 tempest-CinderUnicodeTest-1022596496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.dc2cc628-4119-4eef-9317-3b36fd4be9e2" returned: 0 in 0.272s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3b80a042-e1c9-4609-a3b7-61699f38c632 tempest-CinderUnicodeTest-1022596496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:42 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.info Nov 05 03:59:42 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:42 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3b80a042-e1c9-4609-a3b7-61699f38c632 tempest-CinderUnicodeTest-1022596496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.info" returned: 0 in 0.303s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:42 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-3b80a042-e1c9-4609-a3b7-61699f38c632 tempest-CinderUnicodeTest-1022596496 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.info is being set with open permissions: ugo+rw Nov 05 03:59:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3b80a042-e1c9-4609-a3b7-61699f38c632 tempest-CinderUnicodeTest-1022596496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:42 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.info Nov 05 03:59:42 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:42 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3b80a042-e1c9-4609-a3b7-61699f38c632 tempest-CinderUnicodeTest-1022596496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.info" returned: 0 in 0.265s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3b80a042-e1c9-4609-a3b7-61699f38c632 tempest-CinderUnicodeTest-1022596496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.205s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:43 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-3b80a042-e1c9-4609-a3b7-61699f38c632 tempest-CinderUnicodeTest-1022596496 None] Create snapshot completed successfully Nov 05 03:59:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] Acquiring lock "cinder-dc2cc628-4119-4eef-9317-3b36fd4be9e2-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:59:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] Lock "cinder-dc2cc628-4119-4eef-9317-3b36fd4be9e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:59:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] Acquiring lock "cinder-quobyte-66a95c25-56c0-465f-bfa0-c0136ef620dd" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:59:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] Lock "cinder-quobyte-66a95c25-56c0-465f-bfa0-c0136ef620dd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:59:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] Acquiring lock "cinder-quobyte-dc2cc628-4119-4eef-9317-3b36fd4be9e2" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:59:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] Lock "cinder-quobyte-dc2cc628-4119-4eef-9317-3b36fd4be9e2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:59:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] Deleting offline snapshot dc2cc628-4119-4eef-9317-3b36fd4be9e2 of volume 66a95c25-56c0-465f-bfa0-c0136ef620dd {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 03:59:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] snapshot_file for this snap is: volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.dc2cc628-4119-4eef-9317-3b36fd4be9e2 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 03:59:44 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9d8157-b68c-4891-ad74-6a431997e160]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:59:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.dc2cc628-4119-4eef-9317-3b36fd4be9e2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:44 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.dc2cc628-4119-4eef-9317-3b36fd4be9e2 Nov 05 03:59:44 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:44 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.dc2cc628-4119-4eef-9317-3b36fd4be9e2" returned: 0 in 0.384s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66a95c25-56c0-465f-bfa0-c0136ef620dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 03:59:44 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a78207-59f2-4c02-ae5f-da274f60337e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:59:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:44 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd Nov 05 03:59:44 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:44 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd" returned: 0 in 0.400s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.dc2cc628-4119-4eef-9317-3b36fd4be9e2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:44 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.dc2cc628-4119-4eef-9317-3b36fd4be9e2 Nov 05 03:59:44 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:45 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.dc2cc628-4119-4eef-9317-3b36fd4be9e2" returned: 0 in 0.352s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.dc2cc628-4119-4eef-9317-3b36fd4be9e2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:45 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.dc2cc628-4119-4eef-9317-3b36fd4be9e2 Nov 05 03:59:45 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:45 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd.dc2cc628-4119-4eef-9317-3b36fd4be9e2" returned: 0 in 0.246s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] Lock "cinder-quobyte-dc2cc628-4119-4eef-9317-3b36fd4be9e2" released by "_delete_snapshot" :: held 1.508s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:59:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] Lock "cinder-quobyte-66a95c25-56c0-465f-bfa0-c0136ef620dd" released by "delete_snapshot" :: held 1.531s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:59:45 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] Created reservations ['8ee6e5ba-cd44-4ad1-aca0-1c507a657788', '2d705e86-3a38-4030-9af7-d601ab32489c', '41957933-300d-41a4-a4e9-0e5d8776b9e9', '7993a054-1eaf-4d8e-94d0-288b60878811'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:59:45 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] Delete snapshot completed successfully. Nov 05 03:59:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b8bd4b7f-5414-44e6-b7d6-302dbe7eb51b tempest-CinderUnicodeTest-1022596496 None] Lock "cinder-dc2cc628-4119-4eef-9317-3b36fd4be9e2-delete_snapshot" released by "delete_snapshot" :: held 1.668s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:59:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f6dea793-3aa2-4804-835b-72df9a02b029 tempest-CinderUnicodeTest-1022596496 None] Acquiring lock "cinder-66a95c25-56c0-465f-bfa0-c0136ef620dd-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:59:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f6dea793-3aa2-4804-835b-72df9a02b029 tempest-CinderUnicodeTest-1022596496 None] Lock "cinder-66a95c25-56c0-465f-bfa0-c0136ef620dd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:59:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f6dea793-3aa2-4804-835b-72df9a02b029 tempest-CinderUnicodeTest-1022596496 None] Acquiring lock "cinder-quobyte-66a95c25-56c0-465f-bfa0-c0136ef620dd" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:59:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f6dea793-3aa2-4804-835b-72df9a02b029 tempest-CinderUnicodeTest-1022596496 None] Lock "cinder-quobyte-66a95c25-56c0-465f-bfa0-c0136ef620dd" acquired by "delete_volume" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:59:46 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0e8d54-1287-4c3e-9fb9-be39f72ee68a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:59:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f6dea793-3aa2-4804-835b-72df9a02b029 tempest-CinderUnicodeTest-1022596496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:46 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd Nov 05 03:59:46 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:46 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f6dea793-3aa2-4804-835b-72df9a02b029 tempest-CinderUnicodeTest-1022596496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd" returned: 0 in 0.376s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f6dea793-3aa2-4804-835b-72df9a02b029 tempest-CinderUnicodeTest-1022596496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:46 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd Nov 05 03:59:46 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:46 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f6dea793-3aa2-4804-835b-72df9a02b029 tempest-CinderUnicodeTest-1022596496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-66a95c25-56c0-465f-bfa0-c0136ef620dd" returned: 0 in 0.248s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f6dea793-3aa2-4804-835b-72df9a02b029 tempest-CinderUnicodeTest-1022596496 None] Lock "cinder-quobyte-66a95c25-56c0-465f-bfa0-c0136ef620dd" released by "delete_volume" :: held 0.696s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:59:47 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-f6dea793-3aa2-4804-835b-72df9a02b029 tempest-CinderUnicodeTest-1022596496 None] Created reservations ['bf438640-2aba-4ef1-bf93-ce11120b6e30', '5c7fb4f7-a6da-4855-91e7-5bedac88d77c', '66b9aed3-aaaa-4f59-bcc2-b9e77c4e5e37', '51e43397-7bff-4211-ab41-3e9307d0a23d'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:59:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f6dea793-3aa2-4804-835b-72df9a02b029 tempest-CinderUnicodeTest-1022596496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f6dea793-3aa2-4804-835b-72df9a02b029 tempest-CinderUnicodeTest-1022596496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f6dea793-3aa2-4804-835b-72df9a02b029 tempest-CinderUnicodeTest-1022596496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:59:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f6dea793-3aa2-4804-835b-72df9a02b029 tempest-CinderUnicodeTest-1022596496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:59:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f6dea793-3aa2-4804-835b-72df9a02b029 tempest-CinderUnicodeTest-1022596496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f6dea793-3aa2-4804-835b-72df9a02b029 tempest-CinderUnicodeTest-1022596496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:47 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:59:47 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5e1f7dbd-e6cb-40fe-bded-14e8c0d284b4 tempest-CinderUnicodeTest-1022596496 None] Acquiring lock "cinder-5e80cf02-a923-41aa-936b-2ab67fb347a7-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:59:47 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5e1f7dbd-e6cb-40fe-bded-14e8c0d284b4 tempest-CinderUnicodeTest-1022596496 None] Lock "cinder-5e80cf02-a923-41aa-936b-2ab67fb347a7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:59:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f6dea793-3aa2-4804-835b-72df9a02b029 tempest-CinderUnicodeTest-1022596496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.290s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:47 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-f6dea793-3aa2-4804-835b-72df9a02b029 tempest-CinderUnicodeTest-1022596496 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:59:47 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f6dea793-3aa2-4804-835b-72df9a02b029 tempest-CinderUnicodeTest-1022596496 None] Deleted volume successfully. Nov 05 03:59:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f6dea793-3aa2-4804-835b-72df9a02b029 tempest-CinderUnicodeTest-1022596496 None] Lock "cinder-66a95c25-56c0-465f-bfa0-c0136ef620dd-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:59:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5e1f7dbd-e6cb-40fe-bded-14e8c0d284b4 tempest-CinderUnicodeTest-1022596496 None] Acquiring lock "cinder-quobyte-5e80cf02-a923-41aa-936b-2ab67fb347a7" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:59:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5e1f7dbd-e6cb-40fe-bded-14e8c0d284b4 tempest-CinderUnicodeTest-1022596496 None] Lock "cinder-quobyte-5e80cf02-a923-41aa-936b-2ab67fb347a7" acquired by "delete_volume" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:59:47 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[303bc915-7cd3-421b-82d2-0ff05325d3db]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:59:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5e1f7dbd-e6cb-40fe-bded-14e8c0d284b4 tempest-CinderUnicodeTest-1022596496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e80cf02-a923-41aa-936b-2ab67fb347a7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:47 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e80cf02-a923-41aa-936b-2ab67fb347a7 Nov 05 03:59:47 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:47 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5e1f7dbd-e6cb-40fe-bded-14e8c0d284b4 tempest-CinderUnicodeTest-1022596496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e80cf02-a923-41aa-936b-2ab67fb347a7" returned: 0 in 0.413s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5e1f7dbd-e6cb-40fe-bded-14e8c0d284b4 tempest-CinderUnicodeTest-1022596496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e80cf02-a923-41aa-936b-2ab67fb347a7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:47 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e80cf02-a923-41aa-936b-2ab67fb347a7 Nov 05 03:59:47 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:48 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5e1f7dbd-e6cb-40fe-bded-14e8c0d284b4 tempest-CinderUnicodeTest-1022596496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e80cf02-a923-41aa-936b-2ab67fb347a7" returned: 0 in 0.250s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:48 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5e1f7dbd-e6cb-40fe-bded-14e8c0d284b4 tempest-CinderUnicodeTest-1022596496 None] Lock "cinder-quobyte-5e80cf02-a923-41aa-936b-2ab67fb347a7" released by "delete_volume" :: held 0.708s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:59:48 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-5e1f7dbd-e6cb-40fe-bded-14e8c0d284b4 tempest-CinderUnicodeTest-1022596496 None] Created reservations ['b3206cdb-6a97-4025-b837-aa883cc4be84', '22ab9eab-bf0a-41d7-bc07-27c6037ad2ef', '97717504-75d6-40d1-ac33-537cb8055c9b', '28afa508-ac63-4735-8ab2-0ecfe1c904dc'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:59:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5e1f7dbd-e6cb-40fe-bded-14e8c0d284b4 tempest-CinderUnicodeTest-1022596496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5e1f7dbd-e6cb-40fe-bded-14e8c0d284b4 tempest-CinderUnicodeTest-1022596496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5e1f7dbd-e6cb-40fe-bded-14e8c0d284b4 tempest-CinderUnicodeTest-1022596496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:59:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5e1f7dbd-e6cb-40fe-bded-14e8c0d284b4 tempest-CinderUnicodeTest-1022596496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:59:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5e1f7dbd-e6cb-40fe-bded-14e8c0d284b4 tempest-CinderUnicodeTest-1022596496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5e1f7dbd-e6cb-40fe-bded-14e8c0d284b4 tempest-CinderUnicodeTest-1022596496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:48 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:59:48 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:48 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5e1f7dbd-e6cb-40fe-bded-14e8c0d284b4 tempest-CinderUnicodeTest-1022596496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.264s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:48 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-5e1f7dbd-e6cb-40fe-bded-14e8c0d284b4 tempest-CinderUnicodeTest-1022596496 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:59:48 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5e1f7dbd-e6cb-40fe-bded-14e8c0d284b4 tempest-CinderUnicodeTest-1022596496 None] Deleted volume successfully. Nov 05 03:59:48 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5e1f7dbd-e6cb-40fe-bded-14e8c0d284b4 tempest-CinderUnicodeTest-1022596496 None] Lock "cinder-5e80cf02-a923-41aa-936b-2ab67fb347a7-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:59:57 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-6b368d22-b947-4740-82ef-90e2db8ac5bf tempest-TestShelveInstance-402511666 None] Terminate volume connection completed successfully. Nov 05 03:59:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-6b368d22-b947-4740-82ef-90e2db8ac5bf tempest-TestShelveInstance-402511666 None] Deleting attachment 8c391b58-c4a5-470d-afaf-96fc26b4b661. {{(pid=87109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5076}} Nov 05 03:59:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-41414c6c-8edd-4290-8687-f5ed8b2cbe27 tempest-TestShelveInstance-402511666 None] Acquiring lock "cinder-5e4d989f-0bfd-4647-a10b-703c87050c9d-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:59:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-41414c6c-8edd-4290-8687-f5ed8b2cbe27 tempest-TestShelveInstance-402511666 None] Lock "cinder-5e4d989f-0bfd-4647-a10b-703c87050c9d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:59:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-41414c6c-8edd-4290-8687-f5ed8b2cbe27 tempest-TestShelveInstance-402511666 None] Acquiring lock "cinder-quobyte-5e4d989f-0bfd-4647-a10b-703c87050c9d" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 03:59:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-41414c6c-8edd-4290-8687-f5ed8b2cbe27 tempest-TestShelveInstance-402511666 None] Lock "cinder-quobyte-5e4d989f-0bfd-4647-a10b-703c87050c9d" acquired by "delete_volume" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 03:59:57 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[769f635a-fd7f-4dd4-a9d4-e6344df41494]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 03:59:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-41414c6c-8edd-4290-8687-f5ed8b2cbe27 tempest-TestShelveInstance-402511666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e4d989f-0bfd-4647-a10b-703c87050c9d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:57 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e4d989f-0bfd-4647-a10b-703c87050c9d Nov 05 03:59:57 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:58 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-41414c6c-8edd-4290-8687-f5ed8b2cbe27 tempest-TestShelveInstance-402511666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e4d989f-0bfd-4647-a10b-703c87050c9d" returned: 0 in 0.383s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-41414c6c-8edd-4290-8687-f5ed8b2cbe27 tempest-TestShelveInstance-402511666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e4d989f-0bfd-4647-a10b-703c87050c9d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:58 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e4d989f-0bfd-4647-a10b-703c87050c9d Nov 05 03:59:58 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:58 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-41414c6c-8edd-4290-8687-f5ed8b2cbe27 tempest-TestShelveInstance-402511666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-5e4d989f-0bfd-4647-a10b-703c87050c9d" returned: 0 in 0.249s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-41414c6c-8edd-4290-8687-f5ed8b2cbe27 tempest-TestShelveInstance-402511666 None] Lock "cinder-quobyte-5e4d989f-0bfd-4647-a10b-703c87050c9d" released by "delete_volume" :: held 0.685s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG cinder.quota [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-41414c6c-8edd-4290-8687-f5ed8b2cbe27 tempest-TestShelveInstance-402511666 None] Created reservations ['a79125e0-c5b3-4924-b0ac-3526f213059d', '7dde6cd8-b951-43e7-b480-4e753def7f99', '5d6c23f1-2667-4432-824d-5ff8e9331fb2', '012a2e3c-aceb-4837-8f03-29572f1d1f16'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-41414c6c-8edd-4290-8687-f5ed8b2cbe27 tempest-TestShelveInstance-402511666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-41414c6c-8edd-4290-8687-f5ed8b2cbe27 tempest-TestShelveInstance-402511666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-41414c6c-8edd-4290-8687-f5ed8b2cbe27 tempest-TestShelveInstance-402511666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-41414c6c-8edd-4290-8687-f5ed8b2cbe27 tempest-TestShelveInstance-402511666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-41414c6c-8edd-4290-8687-f5ed8b2cbe27 tempest-TestShelveInstance-402511666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-41414c6c-8edd-4290-8687-f5ed8b2cbe27 tempest-TestShelveInstance-402511666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:58 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:59:58 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 03:59:58 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 03:59:58 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 03:59:58 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-41414c6c-8edd-4290-8687-f5ed8b2cbe27 tempest-TestShelveInstance-402511666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.263s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG cinder.manager [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-41414c6c-8edd-4290-8687-f5ed8b2cbe27 tempest-TestShelveInstance-402511666 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:59:58 devstack cinder-volume[87109]: INFO cinder.volume.manager [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-41414c6c-8edd-4290-8687-f5ed8b2cbe27 tempest-TestShelveInstance-402511666 None] Deleted volume successfully. Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG cinder.coordination [req-04f3bdcc-8ca2-4787-a85d-704889775eef req-41414c6c-8edd-4290-8687-f5ed8b2cbe27 tempest-TestShelveInstance-402511666 None] Lock "cinder-5e4d989f-0bfd-4647-a10b-703c87050c9d-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 03:59:58 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.284s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 28 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 03:59:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 04:00:08 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:UPDATE=47,cinder:INSERT=18,cinder:SELECT=46,cinder:DELETE=2 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:00:08 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=45,cinder:INSERT=15,cinder:UPDATE=52,cinder:DELETE=6 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:00:30 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=1 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:00:30 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:UPDATE=1 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Flow 'volume_create_manager' (6522dda5-dbba-4a09-aaf3-177b41beae2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b2d8ca-b35d-4272-ba17-25e71caf4b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39b2d8ca-b35d-4272-ba17-25e71caf4b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-852088809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9754f184-ab31-4150-a1d5-1a121b4e85b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3baa5c502d7438fa055110a0b162314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:32Z,use_quota=True,user_id='883b5a5b30c946f1a8d114a67c36282d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070f8bc4-d976-48e4-a63e-ee388929ddfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070f8bc4-d976-48e4-a63e-ee388929ddfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48e9e79-6905-40a5-86cf-4aea05a178ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48e9e79-6905-40a5-86cf-4aea05a178ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9754f184-ab31-4150-a1d5-1a121b4e85b7', 'volume_name': 'volume-9754f184-ab31-4150-a1d5-1a121b4e85b7', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b55523d-463d-499b-8f79-ba6269a017ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b55523d-463d-499b-8f79-ba6269a017ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00185f7f-e375-47ed-8278-13706655abe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:00:32 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Volume 9754f184-ab31-4150-a1d5-1a121b4e85b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9754f184-ab31-4150-a1d5-1a121b4e85b7', 'volume_size': 1} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-852088809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9754f184-ab31-4150-a1d5-1a121b4e85b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3baa5c502d7438fa055110a0b162314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:00:32Z,use_quota=True,user_id='883b5a5b30c946f1a8d114a67c36282d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Creating volume 9754f184-ab31-4150-a1d5-1a121b4e85b7 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:00:32 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:00:32 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7 1073741824 Nov 05 04:00:32 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:00:32 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7 1073741824" returned: 0 in 0.404s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:00:32 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7 Nov 05 04:00:32 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:00:32 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7" returned: 0 in 0.232s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00185f7f-e375-47ed-8278-13706655abe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9754f184-ab31-4150-a1d5-1a121b4e85b7', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a663c70b-7736-4120-932d-5c41ff20c491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:00:32 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Volume volume-9754f184-ab31-4150-a1d5-1a121b4e85b7 (9754f184-ab31-4150-a1d5-1a121b4e85b7): created successfully Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a663c70b-7736-4120-932d-5c41ff20c491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:00:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Flow 'volume_create_manager' (6522dda5-dbba-4a09-aaf3-177b41beae2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:00:32 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-9184cbcd-3b5f-4f11-9af2-dcd82bfcc8bd tempest-TestImageHashVerification-142221808 None] Created volume successfully. Nov 05 04:00:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3174e81a-a379-4861-9db6-f251709a36db tempest-TestImageHashVerification-142221808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:00:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3174e81a-a379-4861-9db6-f251709a36db tempest-TestImageHashVerification-142221808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:00:33 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e87666-49f7-465e-8fd0-c9c3c8967c2e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:00:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3174e81a-a379-4861-9db6-f251709a36db tempest-TestImageHashVerification-142221808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:00:34 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7 Nov 05 04:00:34 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:00:34 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Nov 05 04:00:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3174e81a-a379-4861-9db6-f251709a36db tempest-TestImageHashVerification-142221808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7" returned: 0 in 0.353s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:00:34 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[31103c92-7962-4861-a6ff-7f4db0b67540]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:00:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3174e81a-a379-4861-9db6-f251709a36db tempest-TestImageHashVerification-142221808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:00:34 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7 Nov 05 04:00:34 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:00:34 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Nov 05 04:00:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3174e81a-a379-4861-9db6-f251709a36db tempest-TestImageHashVerification-142221808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7" returned: 0 in 0.381s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:00:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3174e81a-a379-4861-9db6-f251709a36db tempest-TestImageHashVerification-142221808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7 /opt/stack/data/cinder/conversion/9754f184-ab31-4150-a1d5-1a121b4e85b7.temp_image.0387b2c2-fed7-4f01-a23b-cd2d5219ffbeshaznenq.img {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:00:34 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7 /opt/stack/data/cinder/conversion/9754f184-ab31-4150-a1d5-1a121b4e85b7.temp_image.0387b2c2-fed7-4f01-a23b-cd2d5219ffbeshaznenq.img Nov 05 04:00:34 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:00:39 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Nov 05 04:00:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3174e81a-a379-4861-9db6-f251709a36db tempest-TestImageHashVerification-142221808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7 /opt/stack/data/cinder/conversion/9754f184-ab31-4150-a1d5-1a121b4e85b7.temp_image.0387b2c2-fed7-4f01-a23b-cd2d5219ffbeshaznenq.img" returned: 0 in 5.108s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:00:39 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad3e328-b81c-4187-9df5-53048238bac2]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:00:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3174e81a-a379-4861-9db6-f251709a36db tempest-TestImageHashVerification-142221808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:00:39 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7 Nov 05 04:00:39 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:00:40 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Nov 05 04:00:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3174e81a-a379-4861-9db6-f251709a36db tempest-TestImageHashVerification-142221808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7" returned: 0 in 0.496s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:00:40 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-3174e81a-a379-4861-9db6-f251709a36db tempest-TestImageHashVerification-142221808 None] Image conversion details: src /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7, size 1024.00 MB, duration 5.11 sec, destination /opt/stack/data/cinder/conversion/9754f184-ab31-4150-a1d5-1a121b4e85b7.temp_image.0387b2c2-fed7-4f01-a23b-cd2d5219ffbeshaznenq.img {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 04:00:40 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-3174e81a-a379-4861-9db6-f251709a36db tempest-TestImageHashVerification-142221808 None] Converted 1024.00 MB image at 200.42 MB/s Nov 05 04:00:40 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-3174e81a-a379-4861-9db6-f251709a36db tempest-TestImageHashVerification-142221808 None] 0387b2c2-fed7-4f01-a23b-cd2d5219ffbe was raw, no need to convert to raw {{(pid=87109) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Nov 05 04:00:42 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:00:50 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:UPDATE=5,cinder:SELECT=4,cinder:INSERT=1 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:00:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:00:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:00:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:00:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:00:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:00:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:00:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:00:58 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:00:58 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:00:58 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Nov 05 04:00:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.251s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:00:58 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:00:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:00:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 28 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 04:00:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 04:00:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3174e81a-a379-4861-9db6-f251709a36db tempest-TestImageHashVerification-142221808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:00:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3174e81a-a379-4861-9db6-f251709a36db tempest-TestImageHashVerification-142221808 None] Uploaded volume to glance image-id: 0387b2c2-fed7-4f01-a23b-cd2d5219ffbe. {{(pid=87109) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1786}} Nov 05 04:00:58 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-3174e81a-a379-4861-9db6-f251709a36db tempest-TestImageHashVerification-142221808 None] Copy volume to image completed successfully. Nov 05 04:01:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-98b62614-a130-4a4d-904b-63dc5d36342c tempest-TestImageHashVerification-142221808 None] Acquiring lock "cinder-9754f184-ab31-4150-a1d5-1a121b4e85b7-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-98b62614-a130-4a4d-904b-63dc5d36342c tempest-TestImageHashVerification-142221808 None] Lock "cinder-9754f184-ab31-4150-a1d5-1a121b4e85b7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-98b62614-a130-4a4d-904b-63dc5d36342c tempest-TestImageHashVerification-142221808 None] Acquiring lock "cinder-quobyte-9754f184-ab31-4150-a1d5-1a121b4e85b7" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-98b62614-a130-4a4d-904b-63dc5d36342c tempest-TestImageHashVerification-142221808 None] Lock "cinder-quobyte-9754f184-ab31-4150-a1d5-1a121b4e85b7" acquired by "delete_volume" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:00 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[537157de-d1a8-4d36-8100-b36c57c1a933]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-98b62614-a130-4a4d-904b-63dc5d36342c tempest-TestImageHashVerification-142221808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:00 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7 Nov 05 04:01:00 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:00 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-98b62614-a130-4a4d-904b-63dc5d36342c tempest-TestImageHashVerification-142221808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7" returned: 0 in 0.358s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-98b62614-a130-4a4d-904b-63dc5d36342c tempest-TestImageHashVerification-142221808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:00 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7 Nov 05 04:01:00 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:01 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-98b62614-a130-4a4d-904b-63dc5d36342c tempest-TestImageHashVerification-142221808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-9754f184-ab31-4150-a1d5-1a121b4e85b7" returned: 0 in 0.239s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-98b62614-a130-4a4d-904b-63dc5d36342c tempest-TestImageHashVerification-142221808 None] Lock "cinder-quobyte-9754f184-ab31-4150-a1d5-1a121b4e85b7" released by "delete_volume" :: held 0.637s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:01 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-98b62614-a130-4a4d-904b-63dc5d36342c tempest-TestImageHashVerification-142221808 None] Created reservations ['2f811936-2a26-45d7-9794-ac27613cbe78', '23e0097b-d7fc-4944-af11-8d02dd1e8cb3', '8c3cd8db-923e-41bc-8344-36659e17f164', '241d5b0e-eea0-4935-8490-55c4ac573add'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:01:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-98b62614-a130-4a4d-904b-63dc5d36342c tempest-TestImageHashVerification-142221808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-98b62614-a130-4a4d-904b-63dc5d36342c tempest-TestImageHashVerification-142221808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-98b62614-a130-4a4d-904b-63dc5d36342c tempest-TestImageHashVerification-142221808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-98b62614-a130-4a4d-904b-63dc5d36342c tempest-TestImageHashVerification-142221808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-98b62614-a130-4a4d-904b-63dc5d36342c tempest-TestImageHashVerification-142221808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-98b62614-a130-4a4d-904b-63dc5d36342c tempest-TestImageHashVerification-142221808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:01 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:01:01 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:01 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-98b62614-a130-4a4d-904b-63dc5d36342c tempest-TestImageHashVerification-142221808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.237s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:01 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-98b62614-a130-4a4d-904b-63dc5d36342c tempest-TestImageHashVerification-142221808 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:01:01 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-98b62614-a130-4a4d-904b-63dc5d36342c tempest-TestImageHashVerification-142221808 None] Deleted volume successfully. Nov 05 04:01:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-98b62614-a130-4a4d-904b-63dc5d36342c tempest-TestImageHashVerification-142221808 None] Lock "cinder-9754f184-ab31-4150-a1d5-1a121b4e85b7-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:11 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=3 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:01:11 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Flow 'volume_create_manager' (183a55cb-b0c7-495c-9c30-862164b4ed18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4619cead-a93d-4f6e-aff3-f28640441b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4619cead-a93d-4f6e-aff3-f28640441b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1416727242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a0fc80-eafb-4acf-8d1c-d841e32f6c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c598a47ee6174a178e2dcea9399bf382',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:12Z,use_quota=True,user_id='0904287d7c024f4c82da718a2802ac15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf6669d6-b6b1-42b2-a46d-0bab43754092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf6669d6-b6b1-42b2-a46d-0bab43754092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58a6169-dba6-46f0-9f25-3835fe8e9495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c58a6169-dba6-46f0-9f25-3835fe8e9495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20a0fc80-eafb-4acf-8d1c-d841e32f6c99', 'volume_name': 'volume-20a0fc80-eafb-4acf-8d1c-d841e32f6c99', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695a26c0-b061-4e32-8d30-e12889d0d241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695a26c0-b061-4e32-8d30-e12889d0d241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad84400-17f5-41f8-a9d4-8208d83a07c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:12 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Volume 20a0fc80-eafb-4acf-8d1c-d841e32f6c99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20a0fc80-eafb-4acf-8d1c-d841e32f6c99', 'volume_size': 1} Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1416727242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a0fc80-eafb-4acf-8d1c-d841e32f6c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c598a47ee6174a178e2dcea9399bf382',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:12Z,use_quota=True,user_id='0904287d7c024f4c82da718a2802ac15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Creating volume 20a0fc80-eafb-4acf-8d1c-d841e32f6c99 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:01:12 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:01:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-20a0fc80-eafb-4acf-8d1c-d841e32f6c99 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:12 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-20a0fc80-eafb-4acf-8d1c-d841e32f6c99 1073741824 Nov 05 04:01:12 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:12 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-20a0fc80-eafb-4acf-8d1c-d841e32f6c99 1073741824" returned: 0 in 0.386s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-20a0fc80-eafb-4acf-8d1c-d841e32f6c99 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:13 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-20a0fc80-eafb-4acf-8d1c-d841e32f6c99 Nov 05 04:01:13 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:13 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-20a0fc80-eafb-4acf-8d1c-d841e32f6c99" returned: 0 in 0.229s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:13 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] <== create_volume: return (654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:01:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.656s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ad84400-17f5-41f8-a9d4-8208d83a07c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20a0fc80-eafb-4acf-8d1c-d841e32f6c99', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25614ed9-3981-480c-9c58-712cb17ea1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:13 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Volume volume-20a0fc80-eafb-4acf-8d1c-d841e32f6c99 (20a0fc80-eafb-4acf-8d1c-d841e32f6c99): created successfully Nov 05 04:01:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25614ed9-3981-480c-9c58-712cb17ea1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Flow 'volume_create_manager' (183a55cb-b0c7-495c-9c30-862164b4ed18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:13 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-8a41c676-cb93-41e2-9621-6ce6b69b6934 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Created volume successfully. Nov 05 04:01:13 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:01:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Flow 'volume_create_manager' (87e3cc34-348d-46e8-8096-5af0f633015b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d040935-9415-4e61-b604-5853c890d102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d040935-9415-4e61-b604-5853c890d102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-405890876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c598a47ee6174a178e2dcea9399bf382',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:14Z,use_quota=True,user_id='0904287d7c024f4c82da718a2802ac15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac49ceb-02ec-498b-9337-55e75b93a454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dac49ceb-02ec-498b-9337-55e75b93a454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3508e975-c6ea-4a36-a706-4a4b819dd37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3508e975-c6ea-4a36-a706-4a4b819dd37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a', 'volume_name': 'volume-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a430871-82df-4a5b-904e-bf47ab193895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a430871-82df-4a5b-904e-bf47ab193895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d5ed1a-0b2c-4763-bca7-4f99204f2b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:14 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Volume e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a', 'volume_size': 1} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-405890876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c598a47ee6174a178e2dcea9399bf382',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:14Z,use_quota=True,user_id='0904287d7c024f4c82da718a2802ac15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Creating volume e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:01:14 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:14 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a 1073741824 Nov 05 04:01:14 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Flow 'volume_create_manager' (25cbb08e-6bed-4ccc-b955-a547a59e005b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9abd56d3-841c-4373-a1b9-91e4466ca531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9abd56d3-841c-4373-a1b9-91e4466ca531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-647506866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=147f1af9-43fc-473e-98ad-04a948f1d3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c598a47ee6174a178e2dcea9399bf382',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:14Z,use_quota=True,user_id='0904287d7c024f4c82da718a2802ac15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a007c676-7eab-467c-b1aa-5e7edebdc64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a007c676-7eab-467c-b1aa-5e7edebdc64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219a8ad2-3ec4-4e26-954f-08c818141f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219a8ad2-3ec4-4e26-954f-08c818141f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '147f1af9-43fc-473e-98ad-04a948f1d3e3', 'volume_name': 'volume-147f1af9-43fc-473e-98ad-04a948f1d3e3', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33083553-cce5-46f7-90e7-07df61c4f8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33083553-cce5-46f7-90e7-07df61c4f8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f52160-4306-428f-9684-4dd9e6412812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:14 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Volume 147f1af9-43fc-473e-98ad-04a948f1d3e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-147f1af9-43fc-473e-98ad-04a948f1d3e3', 'volume_size': 1} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:14 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a 1073741824" returned: 0 in 0.514s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:14 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a Nov 05 04:01:14 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Flow 'volume_create_manager' (fbb072fb-d781-489b-8ae9-5bcea289cd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a98d16-aaf2-4594-acf7-9d66f50e7247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46a98d16-aaf2-4594-acf7-9d66f50e7247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-464718783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c598a47ee6174a178e2dcea9399bf382',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:15Z,use_quota=True,user_id='0904287d7c024f4c82da718a2802ac15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1769c5-e6a0-411c-b49d-1373b31e81c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1769c5-e6a0-411c-b49d-1373b31e81c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ee1889-26c3-4ed1-933f-4bd50d3a1ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ee1889-26c3-4ed1-933f-4bd50d3a1ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1', 'volume_name': 'volume-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2945cf0b-8e8a-4ba1-8c46-05b45200d053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2945cf0b-8e8a-4ba1-8c46-05b45200d053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc52f587-87fe-468d-a57b-1a0df05b0679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:14 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Volume a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1', 'volume_size': 1} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:14 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a" returned: 0 in 0.276s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.487s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-647506866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=147f1af9-43fc-473e-98ad-04a948f1d3e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c598a47ee6174a178e2dcea9399bf382',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:14Z,use_quota=True,user_id='0904287d7c024f4c82da718a2802ac15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Creating volume 147f1af9-43fc-473e-98ad-04a948f1d3e3 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:01:14 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-147f1af9-43fc-473e-98ad-04a948f1d3e3 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:14 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-147f1af9-43fc-473e-98ad-04a948f1d3e3 1073741824 Nov 05 04:01:14 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d5ed1a-0b2c-4763-bca7-4f99204f2b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c69bda7-f4cc-4bd2-861a-02769a54394d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:14 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Volume volume-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a (e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a): created successfully Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c69bda7-f4cc-4bd2-861a-02769a54394d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Flow 'volume_create_manager' (87e3cc34-348d-46e8-8096-5af0f633015b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:14 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-58e0d300-faa7-49ef-ac3c-614686296bc9 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Created volume successfully. Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Flow 'volume_create_manager' (37b58f24-2b79-4c90-a2f7-d9ec07eb9634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57a13b6-ff71-403a-a73c-69d506a01199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57a13b6-ff71-403a-a73c-69d506a01199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-216569020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ff566a-5de5-4407-ba44-723a10995a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c598a47ee6174a178e2dcea9399bf382',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:15Z,use_quota=True,user_id='0904287d7c024f4c82da718a2802ac15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38152eef-a527-40c3-963e-152ac3dea980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38152eef-a527-40c3-963e-152ac3dea980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a27b67-8817-4b6c-aebb-7ae410524ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a27b67-8817-4b6c-aebb-7ae410524ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69ff566a-5de5-4407-ba44-723a10995a41', 'volume_name': 'volume-69ff566a-5de5-4407-ba44-723a10995a41', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c94c54-1a83-4561-80ed-d2692562c3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c94c54-1a83-4561-80ed-d2692562c3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef83514-1ca4-4094-a6f1-52178cc19d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:15 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Volume 69ff566a-5de5-4407-ba44-723a10995a41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69ff566a-5de5-4407-ba44-723a10995a41', 'volume_size': 1} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:15 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-147f1af9-43fc-473e-98ad-04a948f1d3e3 1073741824" returned: 0 in 0.513s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-147f1af9-43fc-473e-98ad-04a948f1d3e3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:15 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-147f1af9-43fc-473e-98ad-04a948f1d3e3 Nov 05 04:01:15 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Flow 'volume_create_manager' (a35de8c4-6fc7-4db3-99d4-e40cd94bc08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd9cac3-28bc-4092-97b0-b1870a54b9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd9cac3-28bc-4092-97b0-b1870a54b9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-620285827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2faed2a-3680-4798-ac27-c65b865b7811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c598a47ee6174a178e2dcea9399bf382',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:15Z,use_quota=True,user_id='0904287d7c024f4c82da718a2802ac15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291ddb55-3492-4933-82d8-141725c3be00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291ddb55-3492-4933-82d8-141725c3be00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc7af40-c517-4a0d-b439-c83756c88e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc7af40-c517-4a0d-b439-c83756c88e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2faed2a-3680-4798-ac27-c65b865b7811', 'volume_name': 'volume-f2faed2a-3680-4798-ac27-c65b865b7811', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9197cf8-1bac-41cb-986f-f9e514a8ffc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9197cf8-1bac-41cb-986f-f9e514a8ffc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62bfee3b-4a47-4acc-8993-201a76b08126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:15 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Volume f2faed2a-3680-4798-ac27-c65b865b7811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2faed2a-3680-4798-ac27-c65b865b7811', 'volume_size': 1} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:15 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-147f1af9-43fc-473e-98ad-04a948f1d3e3" returned: 0 in 0.260s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.983s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-464718783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c598a47ee6174a178e2dcea9399bf382',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:15Z,use_quota=True,user_id='0904287d7c024f4c82da718a2802ac15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Creating volume a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:01:15 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:15 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1 1073741824 Nov 05 04:01:15 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f52160-4306-428f-9684-4dd9e6412812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-147f1af9-43fc-473e-98ad-04a948f1d3e3', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e71f193-b39e-44c4-8e79-512bdf3c3755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:15 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Volume volume-147f1af9-43fc-473e-98ad-04a948f1d3e3 (147f1af9-43fc-473e-98ad-04a948f1d3e3): created successfully Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e71f193-b39e-44c4-8e79-512bdf3c3755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:15 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Flow 'volume_create_manager' (25cbb08e-6bed-4ccc-b955-a547a59e005b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:15 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-97b7d54e-d8ac-4659-9fed-b3e19924b1d0 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Created volume successfully. Nov 05 04:01:16 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1 1073741824" returned: 0 in 0.415s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:16 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1 Nov 05 04:01:16 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:16 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1" returned: 0 in 0.271s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:01:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.283s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-216569020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ff566a-5de5-4407-ba44-723a10995a41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c598a47ee6174a178e2dcea9399bf382',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:15Z,use_quota=True,user_id='0904287d7c024f4c82da718a2802ac15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:01:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Creating volume 69ff566a-5de5-4407-ba44-723a10995a41 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:01:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:01:16 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:01:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69ff566a-5de5-4407-ba44-723a10995a41 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc52f587-87fe-468d-a57b-1a0df05b0679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:16 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69ff566a-5de5-4407-ba44-723a10995a41 1073741824 Nov 05 04:01:16 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a257e22-9106-4b46-9980-b7774e0ef549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:16 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Volume volume-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1 (a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1): created successfully Nov 05 04:01:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a257e22-9106-4b46-9980-b7774e0ef549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:16 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Flow 'volume_create_manager' (fbb072fb-d781-489b-8ae9-5bcea289cd8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:16 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f8f71037-24ac-40ee-9485-9df6294c3a88 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Created volume successfully. Nov 05 04:01:16 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69ff566a-5de5-4407-ba44-723a10995a41 1073741824" returned: 0 in 0.427s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69ff566a-5de5-4407-ba44-723a10995a41 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:16 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69ff566a-5de5-4407-ba44-723a10995a41 Nov 05 04:01:16 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:17 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69ff566a-5de5-4407-ba44-723a10995a41" returned: 0 in 0.237s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.507s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-620285827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2faed2a-3680-4798-ac27-c65b865b7811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c598a47ee6174a178e2dcea9399bf382',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:15Z,use_quota=True,user_id='0904287d7c024f4c82da718a2802ac15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Creating volume f2faed2a-3680-4798-ac27-c65b865b7811 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:01:17 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2faed2a-3680-4798-ac27-c65b865b7811 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef83514-1ca4-4094-a6f1-52178cc19d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69ff566a-5de5-4407-ba44-723a10995a41', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:17 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2faed2a-3680-4798-ac27-c65b865b7811 1073741824 Nov 05 04:01:17 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546f2adf-66de-426d-8c93-e6bc7c7bf7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:17 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Volume volume-69ff566a-5de5-4407-ba44-723a10995a41 (69ff566a-5de5-4407-ba44-723a10995a41): created successfully Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (546f2adf-66de-426d-8c93-e6bc7c7bf7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Flow 'volume_create_manager' (37b58f24-2b79-4c90-a2f7-d9ec07eb9634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:17 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-58779d8e-26ad-45d3-9fdf-314a148b77b5 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Created volume successfully. Nov 05 04:01:17 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2faed2a-3680-4798-ac27-c65b865b7811 1073741824" returned: 0 in 0.400s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2faed2a-3680-4798-ac27-c65b865b7811 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:17 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2faed2a-3680-4798-ac27-c65b865b7811 Nov 05 04:01:17 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:17 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2faed2a-3680-4798-ac27-c65b865b7811" returned: 0 in 0.255s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62bfee3b-4a47-4acc-8993-201a76b08126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2faed2a-3680-4798-ac27-c65b865b7811', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a60e2e-d40a-4a2f-8b2e-2a86c878d128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:17 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Volume volume-f2faed2a-3680-4798-ac27-c65b865b7811 (f2faed2a-3680-4798-ac27-c65b865b7811): created successfully Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a60e2e-d40a-4a2f-8b2e-2a86c878d128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Flow 'volume_create_manager' (a35de8c4-6fc7-4db3-99d4-e40cd94bc08b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:17 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-3942566a-bcab-44c9-8e83-ed7c2e50ef2e tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Created volume successfully. Nov 05 04:01:19 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-049706de-4e78-447a-af6e-1753ff309062 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "cinder-f2faed2a-3680-4798-ac27-c65b865b7811-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:19 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-049706de-4e78-447a-af6e-1753ff309062 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-f2faed2a-3680-4798-ac27-c65b865b7811-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:19 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-049706de-4e78-447a-af6e-1753ff309062 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "cinder-quobyte-f2faed2a-3680-4798-ac27-c65b865b7811" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:19 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-049706de-4e78-447a-af6e-1753ff309062 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-quobyte-f2faed2a-3680-4798-ac27-c65b865b7811" acquired by "delete_volume" :: waited 0.013s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:19 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e2bb71-e1b2-407b-86ea-196c052e2a3d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-049706de-4e78-447a-af6e-1753ff309062 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2faed2a-3680-4798-ac27-c65b865b7811 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:19 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2faed2a-3680-4798-ac27-c65b865b7811 Nov 05 04:01:19 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:19 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-049706de-4e78-447a-af6e-1753ff309062 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2faed2a-3680-4798-ac27-c65b865b7811" returned: 0 in 0.336s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-049706de-4e78-447a-af6e-1753ff309062 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2faed2a-3680-4798-ac27-c65b865b7811 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:19 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2faed2a-3680-4798-ac27-c65b865b7811 Nov 05 04:01:19 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:19 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-049706de-4e78-447a-af6e-1753ff309062 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f2faed2a-3680-4798-ac27-c65b865b7811" returned: 0 in 0.231s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:19 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-049706de-4e78-447a-af6e-1753ff309062 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-quobyte-f2faed2a-3680-4798-ac27-c65b865b7811" released by "delete_volume" :: held 0.605s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:19 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-049706de-4e78-447a-af6e-1753ff309062 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Created reservations ['ab89ac3d-5cc9-4128-89d2-1fd4fd16c781', '674e5c8e-032e-4aa5-acc1-3848b8193fa7', 'a5d221dd-96a1-47a4-b9d5-35e7f411e824', 'd47a7918-672e-4979-b35a-666e247275f2'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:01:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-049706de-4e78-447a-af6e-1753ff309062 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-049706de-4e78-447a-af6e-1753ff309062 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-049706de-4e78-447a-af6e-1753ff309062 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-049706de-4e78-447a-af6e-1753ff309062 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-049706de-4e78-447a-af6e-1753ff309062 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-049706de-4e78-447a-af6e-1753ff309062 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:19 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:01:19 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:20 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-049706de-4e78-447a-af6e-1753ff309062 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.240s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:20 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-049706de-4e78-447a-af6e-1753ff309062 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:01:20 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-049706de-4e78-447a-af6e-1753ff309062 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Deleted volume successfully. Nov 05 04:01:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-049706de-4e78-447a-af6e-1753ff309062 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-f2faed2a-3680-4798-ac27-c65b865b7811-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7d02e4e7-83b4-4133-89ab-a4bc95f63378 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "cinder-69ff566a-5de5-4407-ba44-723a10995a41-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7d02e4e7-83b4-4133-89ab-a4bc95f63378 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-69ff566a-5de5-4407-ba44-723a10995a41-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7d02e4e7-83b4-4133-89ab-a4bc95f63378 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "cinder-quobyte-69ff566a-5de5-4407-ba44-723a10995a41" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7d02e4e7-83b4-4133-89ab-a4bc95f63378 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-quobyte-69ff566a-5de5-4407-ba44-723a10995a41" acquired by "delete_volume" :: waited 0.014s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:20 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ade043-9c6f-46e2-a7cc-e54459ad069e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7d02e4e7-83b4-4133-89ab-a4bc95f63378 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69ff566a-5de5-4407-ba44-723a10995a41 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:20 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69ff566a-5de5-4407-ba44-723a10995a41 Nov 05 04:01:20 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:20 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7d02e4e7-83b4-4133-89ab-a4bc95f63378 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69ff566a-5de5-4407-ba44-723a10995a41" returned: 0 in 0.358s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7d02e4e7-83b4-4133-89ab-a4bc95f63378 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69ff566a-5de5-4407-ba44-723a10995a41 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:20 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69ff566a-5de5-4407-ba44-723a10995a41 Nov 05 04:01:20 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:20 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7d02e4e7-83b4-4133-89ab-a4bc95f63378 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69ff566a-5de5-4407-ba44-723a10995a41" returned: 0 in 0.238s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7d02e4e7-83b4-4133-89ab-a4bc95f63378 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-quobyte-69ff566a-5de5-4407-ba44-723a10995a41" released by "delete_volume" :: held 0.638s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:20 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-7d02e4e7-83b4-4133-89ab-a4bc95f63378 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Created reservations ['d6d7591b-1a99-4104-bfd3-0c758eb5d27b', 'f9c7290c-9244-47db-9acb-f12c74f86bbf', 'bc18a69d-275e-44f7-b494-d541fc54520c', '863ff687-f886-41ab-8e9a-8725f79dc7c4'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:01:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7d02e4e7-83b4-4133-89ab-a4bc95f63378 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7d02e4e7-83b4-4133-89ab-a4bc95f63378 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7d02e4e7-83b4-4133-89ab-a4bc95f63378 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7d02e4e7-83b4-4133-89ab-a4bc95f63378 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7d02e4e7-83b4-4133-89ab-a4bc95f63378 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7d02e4e7-83b4-4133-89ab-a4bc95f63378 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:21 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:01:21 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:21 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7d02e4e7-83b4-4133-89ab-a4bc95f63378 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.230s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:21 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-7d02e4e7-83b4-4133-89ab-a4bc95f63378 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:01:21 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-7d02e4e7-83b4-4133-89ab-a4bc95f63378 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Deleted volume successfully. Nov 05 04:01:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7d02e4e7-83b4-4133-89ab-a4bc95f63378 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-69ff566a-5de5-4407-ba44-723a10995a41-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d6af2afa-47d3-42b1-af70-9cdec3a9a956 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "cinder-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d6af2afa-47d3-42b1-af70-9cdec3a9a956 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d6af2afa-47d3-42b1-af70-9cdec3a9a956 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "cinder-quobyte-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d6af2afa-47d3-42b1-af70-9cdec3a9a956 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-quobyte-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1" acquired by "delete_volume" :: waited 0.013s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:21 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[663dc537-ed4a-4877-b6dd-e7102a7f9c3b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d6af2afa-47d3-42b1-af70-9cdec3a9a956 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:21 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1 Nov 05 04:01:21 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:21 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d6af2afa-47d3-42b1-af70-9cdec3a9a956 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1" returned: 0 in 0.347s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d6af2afa-47d3-42b1-af70-9cdec3a9a956 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:21 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1 Nov 05 04:01:21 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:22 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d6af2afa-47d3-42b1-af70-9cdec3a9a956 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1" returned: 0 in 0.252s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d6af2afa-47d3-42b1-af70-9cdec3a9a956 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-quobyte-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1" released by "delete_volume" :: held 0.639s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:22 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-d6af2afa-47d3-42b1-af70-9cdec3a9a956 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Created reservations ['1247b7d6-c235-417e-a8fb-2f475bc5a007', '786407ec-af94-4624-8f43-eecb0be54730', 'e8c9b4bf-6497-4ec3-9586-330c4c0c7386', 'f13c3537-f612-4830-967c-e54d193011b0'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:01:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d6af2afa-47d3-42b1-af70-9cdec3a9a956 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d6af2afa-47d3-42b1-af70-9cdec3a9a956 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d6af2afa-47d3-42b1-af70-9cdec3a9a956 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d6af2afa-47d3-42b1-af70-9cdec3a9a956 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d6af2afa-47d3-42b1-af70-9cdec3a9a956 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d6af2afa-47d3-42b1-af70-9cdec3a9a956 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:22 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:01:22 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:22 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d6af2afa-47d3-42b1-af70-9cdec3a9a956 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.249s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:22 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-d6af2afa-47d3-42b1-af70-9cdec3a9a956 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:01:22 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-d6af2afa-47d3-42b1-af70-9cdec3a9a956 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Deleted volume successfully. Nov 05 04:01:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d6af2afa-47d3-42b1-af70-9cdec3a9a956 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-a6b5ebbd-ffc9-4d5f-b9dd-039b5d38c0f1-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8ad9c828-bd61-46ac-b5c6-0f5de56415f2 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "cinder-147f1af9-43fc-473e-98ad-04a948f1d3e3-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8ad9c828-bd61-46ac-b5c6-0f5de56415f2 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-147f1af9-43fc-473e-98ad-04a948f1d3e3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8ad9c828-bd61-46ac-b5c6-0f5de56415f2 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "cinder-quobyte-147f1af9-43fc-473e-98ad-04a948f1d3e3" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8ad9c828-bd61-46ac-b5c6-0f5de56415f2 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-quobyte-147f1af9-43fc-473e-98ad-04a948f1d3e3" acquired by "delete_volume" :: waited 0.013s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:22 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e679757-423f-4f5d-ad5f-c10a72c53e8f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8ad9c828-bd61-46ac-b5c6-0f5de56415f2 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-147f1af9-43fc-473e-98ad-04a948f1d3e3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:22 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-147f1af9-43fc-473e-98ad-04a948f1d3e3 Nov 05 04:01:22 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:22 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8ad9c828-bd61-46ac-b5c6-0f5de56415f2 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-147f1af9-43fc-473e-98ad-04a948f1d3e3" returned: 0 in 0.351s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8ad9c828-bd61-46ac-b5c6-0f5de56415f2 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-147f1af9-43fc-473e-98ad-04a948f1d3e3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:22 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-147f1af9-43fc-473e-98ad-04a948f1d3e3 Nov 05 04:01:22 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:23 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8ad9c828-bd61-46ac-b5c6-0f5de56415f2 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-147f1af9-43fc-473e-98ad-04a948f1d3e3" returned: 0 in 0.261s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8ad9c828-bd61-46ac-b5c6-0f5de56415f2 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-quobyte-147f1af9-43fc-473e-98ad-04a948f1d3e3" released by "delete_volume" :: held 0.650s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:23 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-8ad9c828-bd61-46ac-b5c6-0f5de56415f2 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Created reservations ['1071fb2b-c1e1-4f46-ae9c-31724151d48f', 'f68e5cfc-1c8f-47a3-8951-ca22b2d0c06d', '66969d0d-15dc-4c45-8eba-a77d0c976abf', '57c7ae7a-90cd-43f4-88f8-7189844de34c'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:01:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8ad9c828-bd61-46ac-b5c6-0f5de56415f2 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8ad9c828-bd61-46ac-b5c6-0f5de56415f2 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8ad9c828-bd61-46ac-b5c6-0f5de56415f2 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8ad9c828-bd61-46ac-b5c6-0f5de56415f2 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8ad9c828-bd61-46ac-b5c6-0f5de56415f2 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8ad9c828-bd61-46ac-b5c6-0f5de56415f2 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:23 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:01:23 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:23 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8ad9c828-bd61-46ac-b5c6-0f5de56415f2 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.269s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:23 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-8ad9c828-bd61-46ac-b5c6-0f5de56415f2 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:01:23 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-8ad9c828-bd61-46ac-b5c6-0f5de56415f2 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Deleted volume successfully. Nov 05 04:01:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8ad9c828-bd61-46ac-b5c6-0f5de56415f2 tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-147f1af9-43fc-473e-98ad-04a948f1d3e3-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b2338084-d961-4380-8f8c-300adb382f3b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "cinder-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b2338084-d961-4380-8f8c-300adb382f3b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b2338084-d961-4380-8f8c-300adb382f3b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "cinder-quobyte-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b2338084-d961-4380-8f8c-300adb382f3b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-quobyte-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a" acquired by "delete_volume" :: waited 0.014s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:23 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46fc576-3c93-4814-b343-4fc14bbcbb17]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b2338084-d961-4380-8f8c-300adb382f3b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:23 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a Nov 05 04:01:23 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:24 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b2338084-d961-4380-8f8c-300adb382f3b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a" returned: 0 in 0.355s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b2338084-d961-4380-8f8c-300adb382f3b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:24 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a Nov 05 04:01:24 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:24 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b2338084-d961-4380-8f8c-300adb382f3b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a" returned: 0 in 0.250s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b2338084-d961-4380-8f8c-300adb382f3b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-quobyte-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a" released by "delete_volume" :: held 0.644s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:24 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-b2338084-d961-4380-8f8c-300adb382f3b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Created reservations ['8ca7e3f5-75f2-4f63-b0a6-41ee19ef176c', 'f5261ee6-e19e-4aee-922f-9f9e080848cf', '243ccfee-270a-4764-9809-a3e33c385805', '50fb5695-a5cf-432f-aceb-84db8c60115e'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:01:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b2338084-d961-4380-8f8c-300adb382f3b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b2338084-d961-4380-8f8c-300adb382f3b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:24 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b2338084-d961-4380-8f8c-300adb382f3b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:24 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b2338084-d961-4380-8f8c-300adb382f3b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b2338084-d961-4380-8f8c-300adb382f3b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b2338084-d961-4380-8f8c-300adb382f3b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:24 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:01:24 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:24 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b2338084-d961-4380-8f8c-300adb382f3b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.235s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:24 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-b2338084-d961-4380-8f8c-300adb382f3b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:01:24 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b2338084-d961-4380-8f8c-300adb382f3b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Deleted volume successfully. Nov 05 04:01:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b2338084-d961-4380-8f8c-300adb382f3b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-e1c6e0fd-a96c-4ebc-beda-d95e9708fc6a-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-46ab6b3e-3473-47a3-94e7-96ed0fe3279b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "cinder-20a0fc80-eafb-4acf-8d1c-d841e32f6c99-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-46ab6b3e-3473-47a3-94e7-96ed0fe3279b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-20a0fc80-eafb-4acf-8d1c-d841e32f6c99-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-46ab6b3e-3473-47a3-94e7-96ed0fe3279b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "cinder-quobyte-20a0fc80-eafb-4acf-8d1c-d841e32f6c99" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-46ab6b3e-3473-47a3-94e7-96ed0fe3279b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-quobyte-20a0fc80-eafb-4acf-8d1c-d841e32f6c99" acquired by "delete_volume" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:24 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae7ce81-f028-467e-9418-cfd5215e4556]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-46ab6b3e-3473-47a3-94e7-96ed0fe3279b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-20a0fc80-eafb-4acf-8d1c-d841e32f6c99 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:25 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-20a0fc80-eafb-4acf-8d1c-d841e32f6c99 Nov 05 04:01:25 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:25 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-46ab6b3e-3473-47a3-94e7-96ed0fe3279b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-20a0fc80-eafb-4acf-8d1c-d841e32f6c99" returned: 0 in 0.357s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-46ab6b3e-3473-47a3-94e7-96ed0fe3279b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-20a0fc80-eafb-4acf-8d1c-d841e32f6c99 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:25 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-20a0fc80-eafb-4acf-8d1c-d841e32f6c99 Nov 05 04:01:25 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:25 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-46ab6b3e-3473-47a3-94e7-96ed0fe3279b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-20a0fc80-eafb-4acf-8d1c-d841e32f6c99" returned: 0 in 0.238s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-46ab6b3e-3473-47a3-94e7-96ed0fe3279b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-quobyte-20a0fc80-eafb-4acf-8d1c-d841e32f6c99" released by "delete_volume" :: held 0.633s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:25 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-46ab6b3e-3473-47a3-94e7-96ed0fe3279b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Created reservations ['d5fd17d0-f159-47b3-9fe5-73672cd70478', '82659341-2b64-4ab5-a859-6f250496af70', '988c8861-de22-4649-88b4-16c53c04e3ef', 'a911acd4-8059-453c-a45b-6f66904c6a49'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:01:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-46ab6b3e-3473-47a3-94e7-96ed0fe3279b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-46ab6b3e-3473-47a3-94e7-96ed0fe3279b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-46ab6b3e-3473-47a3-94e7-96ed0fe3279b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-46ab6b3e-3473-47a3-94e7-96ed0fe3279b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-46ab6b3e-3473-47a3-94e7-96ed0fe3279b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-46ab6b3e-3473-47a3-94e7-96ed0fe3279b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:25 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:01:25 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:25 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-46ab6b3e-3473-47a3-94e7-96ed0fe3279b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.232s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:25 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-46ab6b3e-3473-47a3-94e7-96ed0fe3279b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:01:25 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-46ab6b3e-3473-47a3-94e7-96ed0fe3279b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Deleted volume successfully. Nov 05 04:01:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-46ab6b3e-3473-47a3-94e7-96ed0fe3279b tempest-CreateVolumesFromSourceVolumeTest-517030642 None] Lock "cinder-20a0fc80-eafb-4acf-8d1c-d841e32f6c99-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Flow 'volume_create_manager' (a1e40669-ed84-4b3f-b6a3-7ac592dabbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8437ea6b-eb01-47c9-b32c-0704eaeed740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8437ea6b-eb01-47c9-b32c-0704eaeed740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-909117784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b78668-c332-40e4-a7a7-fba5f07abd4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceae1616edc42c3b08acca949dc9579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:29Z,use_quota=True,user_id='1c78ad1691f04869882e22519192eda9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e61857-608f-415c-95ac-9ae967b4eab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e61857-608f-415c-95ac-9ae967b4eab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa40ec4-fdc4-4131-91df-c2d74abf4e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa40ec4-fdc4-4131-91df-c2d74abf4e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69b78668-c332-40e4-a7a7-fba5f07abd4e', 'volume_name': 'volume-69b78668-c332-40e4-a7a7-fba5f07abd4e', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c515a63-722a-4b6b-b96e-67f39b4861ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c515a63-722a-4b6b-b96e-67f39b4861ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a536b0-fb52-4930-8974-87d4e82388cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:29 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Volume 69b78668-c332-40e4-a7a7-fba5f07abd4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69b78668-c332-40e4-a7a7-fba5f07abd4e', 'volume_size': 1} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-909117784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69b78668-c332-40e4-a7a7-fba5f07abd4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceae1616edc42c3b08acca949dc9579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:29Z,use_quota=True,user_id='1c78ad1691f04869882e22519192eda9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Creating volume 69b78668-c332-40e4-a7a7-fba5f07abd4e {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:01:29 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69b78668-c332-40e4-a7a7-fba5f07abd4e 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:29 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69b78668-c332-40e4-a7a7-fba5f07abd4e 1073741824 Nov 05 04:01:29 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:29 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69b78668-c332-40e4-a7a7-fba5f07abd4e 1073741824" returned: 0 in 0.412s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69b78668-c332-40e4-a7a7-fba5f07abd4e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:29 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69b78668-c332-40e4-a7a7-fba5f07abd4e Nov 05 04:01:29 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:29 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69b78668-c332-40e4-a7a7-fba5f07abd4e" returned: 0 in 0.268s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a536b0-fb52-4930-8974-87d4e82388cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69b78668-c332-40e4-a7a7-fba5f07abd4e', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a31ba01-38f5-4bfa-8abd-bddca7121d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:29 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Volume volume-69b78668-c332-40e4-a7a7-fba5f07abd4e (69b78668-c332-40e4-a7a7-fba5f07abd4e): created successfully Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a31ba01-38f5-4bfa-8abd-bddca7121d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Flow 'volume_create_manager' (a1e40669-ed84-4b3f-b6a3-7ac592dabbfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:30 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-49a4d948-e79a-450d-b7f7-21563845d1dd tempest-ProjectReaderTests-2146606470 None] Created volume successfully. Nov 05 04:01:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-558c38e1-e1b5-4f96-8571-0895dcbfdc34 tempest-ProjectReaderTests-2146606470 None] Acquiring lock "cinder-69b78668-c332-40e4-a7a7-fba5f07abd4e-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-558c38e1-e1b5-4f96-8571-0895dcbfdc34 tempest-ProjectReaderTests-2146606470 None] Lock "cinder-69b78668-c332-40e4-a7a7-fba5f07abd4e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-558c38e1-e1b5-4f96-8571-0895dcbfdc34 tempest-ProjectReaderTests-2146606470 None] Acquiring lock "cinder-quobyte-69b78668-c332-40e4-a7a7-fba5f07abd4e" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-558c38e1-e1b5-4f96-8571-0895dcbfdc34 tempest-ProjectReaderTests-2146606470 None] Lock "cinder-quobyte-69b78668-c332-40e4-a7a7-fba5f07abd4e" acquired by "delete_volume" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:30 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[27aa6945-8809-4931-b9f0-69bc9133fae2]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-558c38e1-e1b5-4f96-8571-0895dcbfdc34 tempest-ProjectReaderTests-2146606470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69b78668-c332-40e4-a7a7-fba5f07abd4e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:30 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69b78668-c332-40e4-a7a7-fba5f07abd4e Nov 05 04:01:30 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:30 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-558c38e1-e1b5-4f96-8571-0895dcbfdc34 tempest-ProjectReaderTests-2146606470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69b78668-c332-40e4-a7a7-fba5f07abd4e" returned: 0 in 0.348s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-558c38e1-e1b5-4f96-8571-0895dcbfdc34 tempest-ProjectReaderTests-2146606470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69b78668-c332-40e4-a7a7-fba5f07abd4e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:30 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69b78668-c332-40e4-a7a7-fba5f07abd4e Nov 05 04:01:30 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:31 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-558c38e1-e1b5-4f96-8571-0895dcbfdc34 tempest-ProjectReaderTests-2146606470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-69b78668-c332-40e4-a7a7-fba5f07abd4e" returned: 0 in 0.235s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-558c38e1-e1b5-4f96-8571-0895dcbfdc34 tempest-ProjectReaderTests-2146606470 None] Lock "cinder-quobyte-69b78668-c332-40e4-a7a7-fba5f07abd4e" released by "delete_volume" :: held 0.622s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-558c38e1-e1b5-4f96-8571-0895dcbfdc34 tempest-ProjectReaderTests-2146606470 None] Created reservations ['bdc469e8-f4a5-468e-8404-a6ae6174e8a0', 'e73eb625-bfbc-4dcb-b01e-3583d1a513fa', 'f65d7fcc-734c-4af0-998c-13ababd351b9', 'f068dd50-12ba-4ce8-90c7-c34de6e1c3ed'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-558c38e1-e1b5-4f96-8571-0895dcbfdc34 tempest-ProjectReaderTests-2146606470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-558c38e1-e1b5-4f96-8571-0895dcbfdc34 tempest-ProjectReaderTests-2146606470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-558c38e1-e1b5-4f96-8571-0895dcbfdc34 tempest-ProjectReaderTests-2146606470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-558c38e1-e1b5-4f96-8571-0895dcbfdc34 tempest-ProjectReaderTests-2146606470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-558c38e1-e1b5-4f96-8571-0895dcbfdc34 tempest-ProjectReaderTests-2146606470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-558c38e1-e1b5-4f96-8571-0895dcbfdc34 tempest-ProjectReaderTests-2146606470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:31 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:01:31 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:31 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-558c38e1-e1b5-4f96-8571-0895dcbfdc34 tempest-ProjectReaderTests-2146606470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.228s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-558c38e1-e1b5-4f96-8571-0895dcbfdc34 tempest-ProjectReaderTests-2146606470 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:01:31 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-558c38e1-e1b5-4f96-8571-0895dcbfdc34 tempest-ProjectReaderTests-2146606470 None] Deleted volume successfully. Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-558c38e1-e1b5-4f96-8571-0895dcbfdc34 tempest-ProjectReaderTests-2146606470 None] Lock "cinder-69b78668-c332-40e4-a7a7-fba5f07abd4e-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Flow 'volume_create_manager' (dff15d00-cf5f-48c8-93e8-61f924c19a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe845dc7-758d-43d6-b9da-cfb21263e601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe845dc7-758d-43d6-b9da-cfb21263e601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2049040744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43aa9473-1431-47b6-a174-7e7f8488ac12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceae1616edc42c3b08acca949dc9579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:32Z,use_quota=True,user_id='1c78ad1691f04869882e22519192eda9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d8ea86-2711-445f-a8f3-002912968c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d8ea86-2711-445f-a8f3-002912968c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5258bc-1272-463e-a434-08969ed1b127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5258bc-1272-463e-a434-08969ed1b127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43aa9473-1431-47b6-a174-7e7f8488ac12', 'volume_name': 'volume-43aa9473-1431-47b6-a174-7e7f8488ac12', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72bf057-6fc3-424d-828a-ed144016ca06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a72bf057-6fc3-424d-828a-ed144016ca06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a90d2e-4ddd-47ab-90b5-cefbcb51fe40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:31 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Volume 43aa9473-1431-47b6-a174-7e7f8488ac12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43aa9473-1431-47b6-a174-7e7f8488ac12', 'volume_size': 1} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2049040744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43aa9473-1431-47b6-a174-7e7f8488ac12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceae1616edc42c3b08acca949dc9579',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:32Z,use_quota=True,user_id='1c78ad1691f04869882e22519192eda9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:01:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Creating volume 43aa9473-1431-47b6-a174-7e7f8488ac12 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:01:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:01:32 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:01:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-43aa9473-1431-47b6-a174-7e7f8488ac12 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:32 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-43aa9473-1431-47b6-a174-7e7f8488ac12 1073741824 Nov 05 04:01:32 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:32 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-43aa9473-1431-47b6-a174-7e7f8488ac12 1073741824" returned: 0 in 0.402s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-43aa9473-1431-47b6-a174-7e7f8488ac12 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:32 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-43aa9473-1431-47b6-a174-7e7f8488ac12 Nov 05 04:01:32 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:32 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-43aa9473-1431-47b6-a174-7e7f8488ac12" returned: 0 in 0.255s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:01:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a90d2e-4ddd-47ab-90b5-cefbcb51fe40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43aa9473-1431-47b6-a174-7e7f8488ac12', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66477072-9881-45dd-a0cd-26a3440decd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:32 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Volume volume-43aa9473-1431-47b6-a174-7e7f8488ac12 (43aa9473-1431-47b6-a174-7e7f8488ac12): created successfully Nov 05 04:01:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66477072-9881-45dd-a0cd-26a3440decd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Flow 'volume_create_manager' (dff15d00-cf5f-48c8-93e8-61f924c19a7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:32 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-aa2eafec-3d0e-46df-ace9-dbe08e90add7 tempest-ProjectReaderTests-2146606470 None] Created volume successfully. Nov 05 04:01:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-04509b19-e65b-4eb7-93eb-63ed46041259 tempest-ProjectReaderTests-2146606470 None] Acquiring lock "cinder-43aa9473-1431-47b6-a174-7e7f8488ac12-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-04509b19-e65b-4eb7-93eb-63ed46041259 tempest-ProjectReaderTests-2146606470 None] Lock "cinder-43aa9473-1431-47b6-a174-7e7f8488ac12-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-04509b19-e65b-4eb7-93eb-63ed46041259 tempest-ProjectReaderTests-2146606470 None] Acquiring lock "cinder-quobyte-43aa9473-1431-47b6-a174-7e7f8488ac12" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-04509b19-e65b-4eb7-93eb-63ed46041259 tempest-ProjectReaderTests-2146606470 None] Lock "cinder-quobyte-43aa9473-1431-47b6-a174-7e7f8488ac12" acquired by "delete_volume" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:33 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9b5369-c848-4ed5-89de-e103f48f10bb]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-04509b19-e65b-4eb7-93eb-63ed46041259 tempest-ProjectReaderTests-2146606470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-43aa9473-1431-47b6-a174-7e7f8488ac12 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:33 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-43aa9473-1431-47b6-a174-7e7f8488ac12 Nov 05 04:01:33 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:33 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-04509b19-e65b-4eb7-93eb-63ed46041259 tempest-ProjectReaderTests-2146606470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-43aa9473-1431-47b6-a174-7e7f8488ac12" returned: 0 in 0.351s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-04509b19-e65b-4eb7-93eb-63ed46041259 tempest-ProjectReaderTests-2146606470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-43aa9473-1431-47b6-a174-7e7f8488ac12 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:33 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-43aa9473-1431-47b6-a174-7e7f8488ac12 Nov 05 04:01:33 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:33 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-04509b19-e65b-4eb7-93eb-63ed46041259 tempest-ProjectReaderTests-2146606470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-43aa9473-1431-47b6-a174-7e7f8488ac12" returned: 0 in 0.279s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-04509b19-e65b-4eb7-93eb-63ed46041259 tempest-ProjectReaderTests-2146606470 None] Lock "cinder-quobyte-43aa9473-1431-47b6-a174-7e7f8488ac12" released by "delete_volume" :: held 0.673s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:33 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-04509b19-e65b-4eb7-93eb-63ed46041259 tempest-ProjectReaderTests-2146606470 None] Created reservations ['11b3e530-148d-455a-b57d-d3351133cc2a', '2d8435bf-c029-4f00-86f0-c63fb0da477d', 'e28d065a-35b5-4dda-848d-484d2c252abd', '91563207-5818-4496-a765-0f7ec343c297'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:01:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-04509b19-e65b-4eb7-93eb-63ed46041259 tempest-ProjectReaderTests-2146606470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-04509b19-e65b-4eb7-93eb-63ed46041259 tempest-ProjectReaderTests-2146606470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-04509b19-e65b-4eb7-93eb-63ed46041259 tempest-ProjectReaderTests-2146606470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-04509b19-e65b-4eb7-93eb-63ed46041259 tempest-ProjectReaderTests-2146606470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-04509b19-e65b-4eb7-93eb-63ed46041259 tempest-ProjectReaderTests-2146606470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-04509b19-e65b-4eb7-93eb-63ed46041259 tempest-ProjectReaderTests-2146606470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:33 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:01:33 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:34 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-04509b19-e65b-4eb7-93eb-63ed46041259 tempest-ProjectReaderTests-2146606470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.241s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:34 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-04509b19-e65b-4eb7-93eb-63ed46041259 tempest-ProjectReaderTests-2146606470 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:01:34 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-04509b19-e65b-4eb7-93eb-63ed46041259 tempest-ProjectReaderTests-2146606470 None] Deleted volume successfully. Nov 05 04:01:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-04509b19-e65b-4eb7-93eb-63ed46041259 tempest-ProjectReaderTests-2146606470 None] Lock "cinder-43aa9473-1431-47b6-a174-7e7f8488ac12-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:43 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:UPDATE=90,cinder:SELECT=63,cinder:INSERT=21,cinder:DELETE=4 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:01:44 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=65,cinder:INSERT=19,cinder:UPDATE=86,cinder:DELETE=12 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Flow 'volume_create_manager' (0834a055-e6a8-4855-91de-c69083e8bf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ce7e82-4b94-400c-b8ca-99c2b1e9f4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45ce7e82-4b94-400c-b8ca-99c2b1e9f4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1443503756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86389f0-b455-485d-9fb0-541982ecd779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4466f1cdd041488f79fed91ef95942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:46Z,use_quota=True,user_id='81975ad39d8a42448153a1fbeb8b48ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5814969c-62ff-4016-91a1-241292718505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5814969c-62ff-4016-91a1-241292718505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c67ea41-893c-4183-8af2-e0e792f3f164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c67ea41-893c-4183-8af2-e0e792f3f164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b86389f0-b455-485d-9fb0-541982ecd779', 'volume_name': 'volume-b86389f0-b455-485d-9fb0-541982ecd779', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc0e50d-8581-46b8-992f-cf5c6238256a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc0e50d-8581-46b8-992f-cf5c6238256a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c7f971-a692-49a1-9ac2-78fd2c76a267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:46 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Volume b86389f0-b455-485d-9fb0-541982ecd779: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b86389f0-b455-485d-9fb0-541982ecd779', 'volume_size': 1} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1443503756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86389f0-b455-485d-9fb0-541982ecd779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4466f1cdd041488f79fed91ef95942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:46Z,use_quota=True,user_id='81975ad39d8a42448153a1fbeb8b48ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Creating volume b86389f0-b455-485d-9fb0-541982ecd779 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:01:46 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b86389f0-b455-485d-9fb0-541982ecd779 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:46 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b86389f0-b455-485d-9fb0-541982ecd779 1073741824 Nov 05 04:01:46 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Flow 'volume_create_manager' (a2d7e57d-d0f7-4cba-a462-9ca9ad697e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce197e3-9d1b-409f-93d1-f39c9056b38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce197e3-9d1b-409f-93d1-f39c9056b38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-243899158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c05c96-db74-49f8-8c20-14aef022ace6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af6e71bb4d874bf08730c89bb8bf13ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:46Z,use_quota=True,user_id='9cc6af4ad0694e8c8545c09b8d6b7911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7172798-0f94-44ee-81ae-9053687ac31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7172798-0f94-44ee-81ae-9053687ac31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba138e0-93c7-45dc-a1e5-3c7fcf998876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba138e0-93c7-45dc-a1e5-3c7fcf998876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7c05c96-db74-49f8-8c20-14aef022ace6', 'volume_name': 'volume-f7c05c96-db74-49f8-8c20-14aef022ace6', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d130da03-cb6a-4f2e-8b0b-f2a3cf2cae90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d130da03-cb6a-4f2e-8b0b-f2a3cf2cae90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76399f48-f47d-4939-bfb7-df3ca1b8f1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:46 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Volume f7c05c96-db74-49f8-8c20-14aef022ace6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7c05c96-db74-49f8-8c20-14aef022ace6', 'volume_size': 1} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Flow 'volume_create_manager' (d266b8d6-dda5-4aca-b9ca-162bf0807d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f306893a-a580-4cc5-a8cb-027ce930eb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f306893a-a580-4cc5-a8cb-027ce930eb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-346864194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9930057-8ae5-41e4-aa94-9e95adb360f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4466f1cdd041488f79fed91ef95942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:47Z,use_quota=True,user_id='81975ad39d8a42448153a1fbeb8b48ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d17fe71-6e43-43e5-820e-24e6cec890fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d17fe71-6e43-43e5-820e-24e6cec890fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5233ec1d-326b-4665-a0a4-efceb928010a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5233ec1d-326b-4665-a0a4-efceb928010a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9930057-8ae5-41e4-aa94-9e95adb360f1', 'volume_name': 'volume-b9930057-8ae5-41e4-aa94-9e95adb360f1', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (532ef5ce-2c31-41af-a7ae-7a8071e88bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (532ef5ce-2c31-41af-a7ae-7a8071e88bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea901e00-0974-44e0-a0f6-68e3ea6a74f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:47 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Volume b9930057-8ae5-41e4-aa94-9e95adb360f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9930057-8ae5-41e4-aa94-9e95adb360f1', 'volume_size': 1} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Flow 'volume_create_manager' (bd10d468-259f-4dd3-b0a6-6470d947ed44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e0ad3a-54ba-4fba-a242-6275fb6ce704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e0ad3a-54ba-4fba-a242-6275fb6ce704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57869eb-0010-41a1-8f63-f2e5cec29ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84474600dcf543109dd304b83539b578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:47Z,use_quota=True,user_id='72a9b5fa6d814acf8be214ed246562ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a92d677-b7b0-4128-8e2d-c8a7d4ea46a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a92d677-b7b0-4128-8e2d-c8a7d4ea46a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531f3df1-0abf-42f3-ba24-69e1dcc77f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531f3df1-0abf-42f3-ba24-69e1dcc77f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c57869eb-0010-41a1-8f63-f2e5cec29ad4', 'volume_name': 'volume-c57869eb-0010-41a1-8f63-f2e5cec29ad4', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0184a99b-1398-49e6-8461-85a703e2abd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0184a99b-1398-49e6-8461-85a703e2abd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c581458c-3c40-4c2c-ab96-8c82665c9fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:47 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Volume c57869eb-0010-41a1-8f63-f2e5cec29ad4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c57869eb-0010-41a1-8f63-f2e5cec29ad4', 'volume_size': 1} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:47 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b86389f0-b455-485d-9fb0-541982ecd779 1073741824" returned: 0 in 0.638s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Flow 'volume_create_manager' (2248fac8-c822-41ab-ac87-eb650bb4e771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d358ab8f-245e-4221-8439-5ad094c47c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b86389f0-b455-485d-9fb0-541982ecd779 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:47 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b86389f0-b455-485d-9fb0-541982ecd779 Nov 05 04:01:47 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d358ab8f-245e-4221-8439-5ad094c47c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1183955846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512ee959-2e65-4de8-b6e1-c6c8be590e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4466f1cdd041488f79fed91ef95942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:47Z,use_quota=True,user_id='81975ad39d8a42448153a1fbeb8b48ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628f2dea-7453-4dae-a925-c194dc34b0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628f2dea-7453-4dae-a925-c194dc34b0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a625fa5c-9076-4134-b267-4d6abbf48bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a625fa5c-9076-4134-b267-4d6abbf48bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '512ee959-2e65-4de8-b6e1-c6c8be590e96', 'volume_name': 'volume-512ee959-2e65-4de8-b6e1-c6c8be590e96', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (186f66f5-63b9-4221-ae0d-b6d5b1b8beb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (186f66f5-63b9-4221-ae0d-b6d5b1b8beb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4df0e49-3e73-4037-9c04-b6353aecf5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:47 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Volume 512ee959-2e65-4de8-b6e1-c6c8be590e96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-512ee959-2e65-4de8-b6e1-c6c8be590e96', 'volume_size': 1} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:47 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b86389f0-b455-485d-9fb0-541982ecd779" returned: 0 in 0.302s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.841s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-243899158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c05c96-db74-49f8-8c20-14aef022ace6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af6e71bb4d874bf08730c89bb8bf13ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:46Z,use_quota=True,user_id='9cc6af4ad0694e8c8545c09b8d6b7911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Creating volume f7c05c96-db74-49f8-8c20-14aef022ace6 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:01:47 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c7f971-a692-49a1-9ac2-78fd2c76a267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b86389f0-b455-485d-9fb0-541982ecd779', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:47 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6 1073741824 Nov 05 04:01:47 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb1845de-a0b7-45e1-83d5-cbe53ff06797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:47 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Volume volume-b86389f0-b455-485d-9fb0-541982ecd779 (b86389f0-b455-485d-9fb0-541982ecd779): created successfully Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb1845de-a0b7-45e1-83d5-cbe53ff06797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Flow 'volume_create_manager' (0834a055-e6a8-4855-91de-c69083e8bf21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:47 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-6f0c25cd-14ac-4670-ac8e-6926c6ab20ce tempest-CreateVolumesFromImageTest-715748175 None] Created volume successfully. Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Flow 'volume_create_manager' (3bf637da-44a0-40fc-aeae-a51611db5921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6185d80-23bf-4315-844a-99c522aaac9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6185d80-23bf-4315-844a-99c522aaac9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-80702430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c094993d-492e-4373-9f98-0cf7c2bbd07c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4466f1cdd041488f79fed91ef95942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:48Z,use_quota=True,user_id='81975ad39d8a42448153a1fbeb8b48ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6843f8ac-0948-4ee1-bb9d-67958394bf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6843f8ac-0948-4ee1-bb9d-67958394bf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc214d7-debc-4ce1-865a-137d7e3b613c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc214d7-debc-4ce1-865a-137d7e3b613c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c094993d-492e-4373-9f98-0cf7c2bbd07c', 'volume_name': 'volume-c094993d-492e-4373-9f98-0cf7c2bbd07c', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3fa86e-4745-41c7-9625-54377d97ec4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3fa86e-4745-41c7-9625-54377d97ec4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8b4d72-e150-4b27-a853-d0f722d39b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:47 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Volume c094993d-492e-4373-9f98-0cf7c2bbd07c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c094993d-492e-4373-9f98-0cf7c2bbd07c', 'volume_size': 1} Nov 05 04:01:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Flow 'volume_create_manager' (4dc05c95-375e-4699-9a73-bfb906ea0a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd92405-9c84-45a5-a19b-c123d1c0cfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cd92405-9c84-45a5-a19b-c123d1c0cfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-128128061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4466f1cdd041488f79fed91ef95942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:48Z,use_quota=True,user_id='81975ad39d8a42448153a1fbeb8b48ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b256b4ac-2a69-4c70-9d01-3710692be16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b256b4ac-2a69-4c70-9d01-3710692be16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b6fb9ae-8478-45ea-b433-d0a52acc0cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b6fb9ae-8478-45ea-b433-d0a52acc0cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8', 'volume_name': 'volume-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87ab1b8-ccc8-49ee-88af-6a3ab1c458a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e87ab1b8-ccc8-49ee-88af-6a3ab1c458a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf803ca9-01ad-4d6d-88f2-225406c004c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:48 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Volume 8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8', 'volume_size': 1} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:48 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6 1073741824" returned: 0 in 0.665s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:48 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6 Nov 05 04:01:48 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:48 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6" returned: 0 in 0.260s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.707s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-346864194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9930057-8ae5-41e4-aa94-9e95adb360f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4466f1cdd041488f79fed91ef95942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:47Z,use_quota=True,user_id='81975ad39d8a42448153a1fbeb8b48ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Creating volume b9930057-8ae5-41e4-aa94-9e95adb360f1 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:01:48 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b9930057-8ae5-41e4-aa94-9e95adb360f1 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:48 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b9930057-8ae5-41e4-aa94-9e95adb360f1 1073741824 Nov 05 04:01:48 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76399f48-f47d-4939-bfb7-df3ca1b8f1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7c05c96-db74-49f8-8c20-14aef022ace6', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f75a40-64f3-440a-8b3b-3e515b26f54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:48 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Volume volume-f7c05c96-db74-49f8-8c20-14aef022ace6 (f7c05c96-db74-49f8-8c20-14aef022ace6): created successfully Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f75a40-64f3-440a-8b3b-3e515b26f54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Flow 'volume_create_manager' (a2d7e57d-d0f7-4cba-a462-9ca9ad697e82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:48 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-ecc6d427-bdaf-4084-a856-7fb70afa9a35 tempest-VolumeDependencyTests-829250185 None] Created volume successfully. Nov 05 04:01:49 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b9930057-8ae5-41e4-aa94-9e95adb360f1 1073741824" returned: 0 in 0.446s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b9930057-8ae5-41e4-aa94-9e95adb360f1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:49 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b9930057-8ae5-41e4-aa94-9e95adb360f1 Nov 05 04:01:49 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:49 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b9930057-8ae5-41e4-aa94-9e95adb360f1" returned: 0 in 0.265s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:49 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:01:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.217s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:49 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c57869eb-0010-41a1-8f63-f2e5cec29ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84474600dcf543109dd304b83539b578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:47Z,use_quota=True,user_id='72a9b5fa6d814acf8be214ed246562ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:01:49 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Creating volume c57869eb-0010-41a1-8f63-f2e5cec29ad4 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:01:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:49 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:49 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:49 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:01:49 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:01:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c57869eb-0010-41a1-8f63-f2e5cec29ad4 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:49 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea901e00-0974-44e0-a0f6-68e3ea6a74f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9930057-8ae5-41e4-aa94-9e95adb360f1', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:49 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c57869eb-0010-41a1-8f63-f2e5cec29ad4 1073741824 Nov 05 04:01:49 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:49 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38cfb3ff-d81a-4873-9569-db7cf96b7f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:49 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Volume volume-b9930057-8ae5-41e4-aa94-9e95adb360f1 (b9930057-8ae5-41e4-aa94-9e95adb360f1): created successfully Nov 05 04:01:49 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38cfb3ff-d81a-4873-9569-db7cf96b7f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:49 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Flow 'volume_create_manager' (d266b8d6-dda5-4aca-b9ca-162bf0807d12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:49 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-0240a45b-8377-40aa-831d-d3e577a9f2f7 tempest-CreateVolumesFromImageTest-715748175 None] Created volume successfully. Nov 05 04:01:50 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c57869eb-0010-41a1-8f63-f2e5cec29ad4 1073741824" returned: 0 in 0.545s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c57869eb-0010-41a1-8f63-f2e5cec29ad4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:50 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c57869eb-0010-41a1-8f63-f2e5cec29ad4 Nov 05 04:01:50 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ad85dd30-fe35-4fef-8487-f44aef3e9f96 tempest-VolumeDependencyTests-829250185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:50 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c57869eb-0010-41a1-8f63-f2e5cec29ad4" returned: 0 in 0.265s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.819s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1183955846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=512ee959-2e65-4de8-b6e1-c6c8be590e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4466f1cdd041488f79fed91ef95942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:47Z,use_quota=True,user_id='81975ad39d8a42448153a1fbeb8b48ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Creating volume 512ee959-2e65-4de8-b6e1-c6c8be590e96 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:01:50 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-512ee959-2e65-4de8-b6e1-c6c8be590e96 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c581458c-3c40-4c2c-ab96-8c82665c9fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c57869eb-0010-41a1-8f63-f2e5cec29ad4', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:50 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-512ee959-2e65-4de8-b6e1-c6c8be590e96 1073741824 Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771a14de-ba78-4b31-b2ea-f4001b33718c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:50 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:50 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Volume volume-c57869eb-0010-41a1-8f63-f2e5cec29ad4 (c57869eb-0010-41a1-8f63-f2e5cec29ad4): created successfully Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771a14de-ba78-4b31-b2ea-f4001b33718c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Flow 'volume_create_manager' (bd10d468-259f-4dd3-b0a6-6470d947ed44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:50 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-9b7a8a6e-3494-4e0c-a770-5da8f641f109 tempest-CinderUnicodeTest-1477526589 None] Created volume successfully. Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Flow 'volume_create_manager' (250efbf9-72c2-479c-aef6-c66c466a5e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249bca9a-6bf8-4888-8439-b1b76a156b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (249bca9a-6bf8-4888-8439-b1b76a156b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a57e0bc-67d0-42bf-8094-f6ac4ea78e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9096546d198d40b7904ee621db1354dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:51Z,use_quota=True,user_id='7c3a778c91264b129f8f71e303c64402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1965a320-d189-4130-b4e5-38e02f4739a7),volume_type_id=1965a320-d189-4130-b4e5-38e02f4739a7)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771423f1-7483-426b-9011-868d4f1badd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771423f1-7483-426b-9011-868d4f1badd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1edfb14e-6099-4000-8f05-2ccea7e31da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.image.glance [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Creating Keystone auth plugin from conf {{(pid=87109) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 04:01:50 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-512ee959-2e65-4de8-b6e1-c6c8be590e96 1073741824" returned: 0 in 0.475s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-512ee959-2e65-4de8-b6e1-c6c8be590e96 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:50 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-512ee959-2e65-4de8-b6e1-c6c8be590e96 Nov 05 04:01:50 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1edfb14e-6099-4000-8f05-2ccea7e31da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8a57e0bc-67d0-42bf-8094-f6ac4ea78e70', 'volume_name': 'volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70', 'volume_size': 1, 'image_id': '89fad89f-caa6-4975-af33-b2334ccafe35', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89fad89f-caa6-4975-af33-b2334ccafe35', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5687d6fd474848139c2a9775adc6e500', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9096546d198d40b7904ee621db1354dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1dec116d760ff555294de34635143f03b53bf40eeb42335ffd9f506bf7d520df426ff1ba9cad2a19ce76c6a05214c0ba05b950807c17ff7c34808b17aa386899', 'id': '89fad89f-caa6-4975-af33-b2334ccafe35', 'created_at': datetime.datetime(2026, 11, 5, 3, 1, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 1, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89fad89f-caa6-4975-af33-b2334ccafe35/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060c2570-ebd8-497d-b506-2a45a2c2bd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060c2570-ebd8-497d-b506-2a45a2c2bd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e116481d-704e-4882-abd2-329ffacb6a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:50 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Volume 8a57e0bc-67d0-42bf-8094-f6ac4ea78e70: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70', 'volume_size': 1, 'image_id': '89fad89f-caa6-4975-af33-b2334ccafe35', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89fad89f-caa6-4975-af33-b2334ccafe35', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5687d6fd474848139c2a9775adc6e500', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9096546d198d40b7904ee621db1354dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1dec116d760ff555294de34635143f03b53bf40eeb42335ffd9f506bf7d520df426ff1ba9cad2a19ce76c6a05214c0ba05b950807c17ff7c34808b17aa386899', 'id': '89fad89f-caa6-4975-af33-b2334ccafe35', 'created_at': datetime.datetime(2026, 11, 5, 3, 1, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 1, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89fad89f-caa6-4975-af33-b2334ccafe35/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 04:01:50 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Trying to clone 8a57e0bc-67d0-42bf-8094-f6ac4ea78e70 from image 89fad89f-caa6-4975-af33-b2334ccafe35 at location (None, [{'url': 'file:///opt/stack/data/glance/images/89fad89f-caa6-4975-af33-b2334ccafe35', 'metadata': {}}]). {{(pid=87109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 05 04:01:51 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Image download 0.00 MB at 0.00 MB/s Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3cd93e-20a6-42e8-969c-37352a3cb300]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:51 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-512ee959-2e65-4de8-b6e1-c6c8be590e96" returned: 0 in 0.275s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.169s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-80702430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c094993d-492e-4373-9f98-0cf7c2bbd07c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4466f1cdd041488f79fed91ef95942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:48Z,use_quota=True,user_id='81975ad39d8a42448153a1fbeb8b48ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Creating volume c094993d-492e-4373-9f98-0cf7c2bbd07c {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:01:51 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c094993d-492e-4373-9f98-0cf7c2bbd07c 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4df0e49-3e73-4037-9c04-b6353aecf5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-512ee959-2e65-4de8-b6e1-c6c8be590e96', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:51 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c094993d-492e-4373-9f98-0cf7c2bbd07c 1073741824 Nov 05 04:01:51 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085dd271-fa8a-4cd7-ade0-79d9795e6f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:51 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Volume volume-512ee959-2e65-4de8-b6e1-c6c8be590e96 (512ee959-2e65-4de8-b6e1-c6c8be590e96): created successfully Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085dd271-fa8a-4cd7-ade0-79d9795e6f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Flow 'volume_create_manager' (2248fac8-c822-41ab-ac87-eb650bb4e771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:51 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD Nov 05 04:01:51 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:51 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-df4fb4c8-bb19-4fb9-a95d-d85790534dce tempest-CreateVolumesFromImageTest-715748175 None] Created volume successfully. Nov 05 04:01:51 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:51 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD Nov 05 04:01:51 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:51 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c094993d-492e-4373-9f98-0cf7c2bbd07c 1073741824" returned: 0 in 0.534s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c094993d-492e-4373-9f98-0cf7c2bbd07c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:51 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c094993d-492e-4373-9f98-0cf7c2bbd07c Nov 05 04:01:51 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:51 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD" returned: 1 in 0.390s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Temporary image 89fad89f-caa6-4975-af33-b2334ccafe35 is fetched for user 7c3a778c91264b129f8f71e303c64402. {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f434d0e-66cd-4169-882a-f15709b86baf]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:52 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c094993d-492e-4373-9f98-0cf7c2bbd07c" returned: 0 in 0.284s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.687s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-128128061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4466f1cdd041488f79fed91ef95942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:48Z,use_quota=True,user_id='81975ad39d8a42448153a1fbeb8b48ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Creating volume 8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:01:52 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:52 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD Nov 05 04:01:52 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8b4d72-e150-4b27-a853-d0f722d39b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c094993d-492e-4373-9f98-0cf7c2bbd07c', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:52 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8 1073741824 Nov 05 04:01:52 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bec0a6c-66d3-464b-82b8-0956f78d03a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:52 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Volume volume-c094993d-492e-4373-9f98-0cf7c2bbd07c (c094993d-492e-4373-9f98-0cf7c2bbd07c): created successfully Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bec0a6c-66d3-464b-82b8-0956f78d03a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Flow 'volume_create_manager' (3bf637da-44a0-40fc-aeae-a51611db5921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:52 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-8f963418-c074-413f-8821-ce5edce4ff5e tempest-CreateVolumesFromImageTest-715748175 None] Created volume successfully. Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Flow 'volume_create_manager' (65b49c7b-e7e1-4336-9b05-7068498e5f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (816581b0-3499-4711-8e6b-f01e875e30d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (816581b0-3499-4711-8e6b-f01e875e30d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-992349311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea388ef-f298-43e7-9186-7768811048a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84474600dcf543109dd304b83539b578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:52Z,use_quota=True,user_id='72a9b5fa6d814acf8be214ed246562ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcef3f0d-7678-4df9-90bd-364392ab495d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcef3f0d-7678-4df9-90bd-364392ab495d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c02780-6ca4-4d98-af16-9fd7aaad87db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c02780-6ca4-4d98-af16-9fd7aaad87db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ea388ef-f298-43e7-9186-7768811048a1', 'volume_name': 'volume-6ea388ef-f298-43e7-9186-7768811048a1', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:52 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3cda8ec-f857-4636-80d8-d24778231319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3cda8ec-f857-4636-80d8-d24778231319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd90183-0a62-4e0c-86c0-d17a81427e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:52 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Volume 6ea388ef-f298-43e7-9186-7768811048a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ea388ef-f298-43e7-9186-7768811048a1', 'volume_size': 1} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD" returned: 0 in 0.413s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:52 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD Nov 05 04:01:52 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:52 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8 1073741824" returned: 0 in 0.495s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:52 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8 Nov 05 04:01:52 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:52 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD" returned: 1 in 0.349s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:52 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8" returned: 0 in 0.264s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ad85dd30-fe35-4fef-8487-f44aef3e9f96 tempest-VolumeDependencyTests-829250185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.738s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf803ca9-01ad-4d6d-88f2-225406c004c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e22ac30-9547-4f1f-aa48-b74395a33f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-ad85dd30-fe35-4fef-8487-f44aef3e9f96 tempest-VolumeDependencyTests-829250185 None] Creating offline snapshot 8d36edaf-dd72-4551-a227-9b292428ebad of volume f7c05c96-db74-49f8-8c20-14aef022ace6 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:01:52 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Volume volume-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8 (8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8): created successfully Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e22ac30-9547-4f1f-aa48-b74395a33f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Flow 'volume_create_manager' (4dc05c95-375e-4699-9a73-bfb906ea0a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09fc8fe-9f0c-4052-9713-632d9494f244]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ad85dd30-fe35-4fef-8487-f44aef3e9f96 tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:52 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-db46e67b-6021-4408-93a3-ef2954ed526b tempest-CreateVolumesFromImageTest-715748175 None] Created volume successfully. Nov 05 04:01:52 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6 Nov 05 04:01:52 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:53 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ad85dd30-fe35-4fef-8487-f44aef3e9f96 tempest-VolumeDependencyTests-829250185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6" returned: 0 in 0.347s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ad85dd30-fe35-4fef-8487-f44aef3e9f96 tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:53 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad 1G Nov 05 04:01:53 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:53 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ad85dd30-fe35-4fef-8487-f44aef3e9f96 tempest-VolumeDependencyTests-829250185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad 1G" returned: 0 in 0.373s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ad85dd30-fe35-4fef-8487-f44aef3e9f96 tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c05c96-db74-49f8-8c20-14aef022ace6 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:53 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c05c96-db74-49f8-8c20-14aef022ace6 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad Nov 05 04:01:53 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a740824c-7e57-4ecb-a7f7-747e2ed8430c tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "cinder-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a740824c-7e57-4ecb-a7f7-747e2ed8430c tempest-CreateVolumesFromImageTest-715748175 None] Lock "cinder-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:53 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ad85dd30-fe35-4fef-8487-f44aef3e9f96 tempest-VolumeDependencyTests-829250185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c05c96-db74-49f8-8c20-14aef022ace6 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad" returned: 0 in 0.307s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:53 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-ad85dd30-fe35-4fef-8487-f44aef3e9f96 tempest-VolumeDependencyTests-829250185 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad is being set with open permissions: ugo+rw Nov 05 04:01:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ad85dd30-fe35-4fef-8487-f44aef3e9f96 tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:53 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad Nov 05 04:01:53 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a740824c-7e57-4ecb-a7f7-747e2ed8430c tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "cinder-quobyte-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a740824c-7e57-4ecb-a7f7-747e2ed8430c tempest-CreateVolumesFromImageTest-715748175 None] Lock "cinder-quobyte-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8" acquired by "delete_volume" :: waited 0.014s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:53 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a02adc-db34-4cb1-88ae-0af53699f520]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a740824c-7e57-4ecb-a7f7-747e2ed8430c tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:54 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8 Nov 05 04:01:54 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:54 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ad85dd30-fe35-4fef-8487-f44aef3e9f96 tempest-VolumeDependencyTests-829250185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad" returned: 0 in 0.251s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ad85dd30-fe35-4fef-8487-f44aef3e9f96 tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:54 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.info Nov 05 04:01:54 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:54 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a740824c-7e57-4ecb-a7f7-747e2ed8430c tempest-CreateVolumesFromImageTest-715748175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8" returned: 0 in 0.375s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a740824c-7e57-4ecb-a7f7-747e2ed8430c tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:54 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8 Nov 05 04:01:54 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:54 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ad85dd30-fe35-4fef-8487-f44aef3e9f96 tempest-VolumeDependencyTests-829250185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.info" returned: 0 in 0.258s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:54 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-ad85dd30-fe35-4fef-8487-f44aef3e9f96 tempest-VolumeDependencyTests-829250185 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.info is being set with open permissions: ugo+rw Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ad85dd30-fe35-4fef-8487-f44aef3e9f96 tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:54 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.info Nov 05 04:01:54 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:54 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a740824c-7e57-4ecb-a7f7-747e2ed8430c tempest-CreateVolumesFromImageTest-715748175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8" returned: 0 in 0.260s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a740824c-7e57-4ecb-a7f7-747e2ed8430c tempest-CreateVolumesFromImageTest-715748175 None] Lock "cinder-quobyte-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8" released by "delete_volume" :: held 0.683s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-a740824c-7e57-4ecb-a7f7-747e2ed8430c tempest-CreateVolumesFromImageTest-715748175 None] Created reservations ['a07a5e73-5b88-4e96-b22d-0d2169654fd7', '71d2ddc5-75b2-41cc-887e-3a663dcd6fc9', '82f5a070-326c-4e60-95d4-bb1e4a821a32', '70435f0c-5027-4033-b253-447a31bee189'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:01:54 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ad85dd30-fe35-4fef-8487-f44aef3e9f96 tempest-VolumeDependencyTests-829250185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.info" returned: 0 in 0.270s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ad85dd30-fe35-4fef-8487-f44aef3e9f96 tempest-VolumeDependencyTests-829250185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.918s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.418s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-992349311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea388ef-f298-43e7-9186-7768811048a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84474600dcf543109dd304b83539b578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:52Z,use_quota=True,user_id='72a9b5fa6d814acf8be214ed246562ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Creating volume 6ea388ef-f298-43e7-9186-7768811048a1 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:01:54 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:54 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1 1073741824 Nov 05 04:01:54 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:54 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-ad85dd30-fe35-4fef-8487-f44aef3e9f96 tempest-VolumeDependencyTests-829250185 None] Create snapshot completed successfully Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a740824c-7e57-4ecb-a7f7-747e2ed8430c tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a740824c-7e57-4ecb-a7f7-747e2ed8430c tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a740824c-7e57-4ecb-a7f7-747e2ed8430c tempest-CreateVolumesFromImageTest-715748175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a740824c-7e57-4ecb-a7f7-747e2ed8430c tempest-CreateVolumesFromImageTest-715748175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a740824c-7e57-4ecb-a7f7-747e2ed8430c tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a740824c-7e57-4ecb-a7f7-747e2ed8430c tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:54 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:01:54 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-edd4afef-1c03-463c-8143-37bde4eac3ad tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "cinder-c094993d-492e-4373-9f98-0cf7c2bbd07c-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-edd4afef-1c03-463c-8143-37bde4eac3ad tempest-CreateVolumesFromImageTest-715748175 None] Lock "cinder-c094993d-492e-4373-9f98-0cf7c2bbd07c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:55 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a740824c-7e57-4ecb-a7f7-747e2ed8430c tempest-CreateVolumesFromImageTest-715748175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.286s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-a740824c-7e57-4ecb-a7f7-747e2ed8430c tempest-CreateVolumesFromImageTest-715748175 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-edd4afef-1c03-463c-8143-37bde4eac3ad tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "cinder-quobyte-c094993d-492e-4373-9f98-0cf7c2bbd07c" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:55 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-a740824c-7e57-4ecb-a7f7-747e2ed8430c tempest-CreateVolumesFromImageTest-715748175 None] Deleted volume successfully. Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-edd4afef-1c03-463c-8143-37bde4eac3ad tempest-CreateVolumesFromImageTest-715748175 None] Lock "cinder-quobyte-c094993d-492e-4373-9f98-0cf7c2bbd07c" acquired by "delete_volume" :: waited 0.025s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a740824c-7e57-4ecb-a7f7-747e2ed8430c tempest-CreateVolumesFromImageTest-715748175 None] Lock "cinder-8b2e6112-d5f4-48cb-a239-6eb0ab2b97a8-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f27e90-4d63-46ac-8656-22403807490c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-edd4afef-1c03-463c-8143-37bde4eac3ad tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c094993d-492e-4373-9f98-0cf7c2bbd07c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:55 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c094993d-492e-4373-9f98-0cf7c2bbd07c Nov 05 04:01:55 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:55 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1 1073741824" returned: 0 in 0.565s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:55 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1 Nov 05 04:01:55 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:55 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-edd4afef-1c03-463c-8143-37bde4eac3ad tempest-CreateVolumesFromImageTest-715748175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c094993d-492e-4373-9f98-0cf7c2bbd07c" returned: 0 in 0.401s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-edd4afef-1c03-463c-8143-37bde4eac3ad tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c094993d-492e-4373-9f98-0cf7c2bbd07c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:55 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c094993d-492e-4373-9f98-0cf7c2bbd07c Nov 05 04:01:55 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:55 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1" returned: 0 in 0.286s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.974s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a57e0bc-67d0-42bf-8094-f6ac4ea78e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9096546d198d40b7904ee621db1354dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:51Z,use_quota=True,user_id='7c3a778c91264b129f8f71e303c64402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1965a320-d189-4130-b4e5-38e02f4739a7),volume_type_id=1965a320-d189-4130-b4e5-38e02f4739a7)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Creating volume 8a57e0bc-67d0-42bf-8094-f6ac4ea78e70 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:01:55 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:55 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70 1073741824 Nov 05 04:01:55 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd90183-0a62-4e0c-86c0-d17a81427e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ea388ef-f298-43e7-9186-7768811048a1', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c80db9d-7506-4b17-a423-f2c545d29236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:55 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Volume volume-6ea388ef-f298-43e7-9186-7768811048a1 (6ea388ef-f298-43e7-9186-7768811048a1): created successfully Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c80db9d-7506-4b17-a423-f2c545d29236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Flow 'volume_create_manager' (65b49c7b-e7e1-4336-9b05-7068498e5f24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:55 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-e642b262-6204-440a-873b-e265d1d46330 tempest-CinderUnicodeTest-1477526589 None] Created volume successfully. Nov 05 04:01:55 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-edd4afef-1c03-463c-8143-37bde4eac3ad tempest-CreateVolumesFromImageTest-715748175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c094993d-492e-4373-9f98-0cf7c2bbd07c" returned: 0 in 0.320s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-edd4afef-1c03-463c-8143-37bde4eac3ad tempest-CreateVolumesFromImageTest-715748175 None] Lock "cinder-quobyte-c094993d-492e-4373-9f98-0cf7c2bbd07c" released by "delete_volume" :: held 0.779s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:55 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Flow 'volume_create_manager' (2dbf4319-5982-4212-9db6-3193526b4e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c439e0-f098-4654-adf4-ba9ed9e6a35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c439e0-f098-4654-adf4-ba9ed9e6a35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1458038016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4377d754-c768-45b2-b6e1-e8d2160c2f86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af6e71bb4d874bf08730c89bb8bf13ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8d36edaf-dd72-4551-a227-9b292428ebad,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:01:56Z,use_quota=True,user_id='9cc6af4ad0694e8c8545c09b8d6b7911',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c384bc-cf0c-48ad-8634-15089f0bf19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c384bc-cf0c-48ad-8634-15089f0bf19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22d46d2-dc47-4c12-88c0-414963bfb851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22d46d2-dc47-4c12-88c0-414963bfb851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4377d754-c768-45b2-b6e1-e8d2160c2f86', 'volume_name': 'volume-4377d754-c768-45b2-b6e1-e8d2160c2f86', 'volume_size': 1, 'snapshot_id': '8d36edaf-dd72-4551-a227-9b292428ebad'}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1d6f58-d1b4-4f97-a806-f021fcc3aba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1d6f58-d1b4-4f97-a806-f021fcc3aba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553d6d3d-6765-4081-91fa-df33341e2ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:01:56 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Volume 4377d754-c768-45b2-b6e1-e8d2160c2f86: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4377d754-c768-45b2-b6e1-e8d2160c2f86', 'volume_size': 1, 'snapshot_id': '8d36edaf-dd72-4551-a227-9b292428ebad'} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-edd4afef-1c03-463c-8143-37bde4eac3ad tempest-CreateVolumesFromImageTest-715748175 None] Created reservations ['5b88905e-5394-4540-8be5-da20c67849f3', '5d234f7e-a833-44db-bc10-4664e13cfda2', '41f45316-a9bb-4a8b-a791-0736ef3b60d8', 'e4810fb5-ecd2-4bdf-8dc8-00460d5746ce'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-edd4afef-1c03-463c-8143-37bde4eac3ad tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-edd4afef-1c03-463c-8143-37bde4eac3ad tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-edd4afef-1c03-463c-8143-37bde4eac3ad tempest-CreateVolumesFromImageTest-715748175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-edd4afef-1c03-463c-8143-37bde4eac3ad tempest-CreateVolumesFromImageTest-715748175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-edd4afef-1c03-463c-8143-37bde4eac3ad tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-edd4afef-1c03-463c-8143-37bde4eac3ad tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:56 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:01:56 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:56 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70 1073741824" returned: 0 in 0.536s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-79298ef5-2fd7-499c-bea5-7f1b3f3a98e0 tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "cinder-512ee959-2e65-4de8-b6e1-c6c8be590e96-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-79298ef5-2fd7-499c-bea5-7f1b3f3a98e0 tempest-CreateVolumesFromImageTest-715748175 None] Lock "cinder-512ee959-2e65-4de8-b6e1-c6c8be590e96-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:56 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70 Nov 05 04:01:56 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-79298ef5-2fd7-499c-bea5-7f1b3f3a98e0 tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "cinder-quobyte-512ee959-2e65-4de8-b6e1-c6c8be590e96" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-79298ef5-2fd7-499c-bea5-7f1b3f3a98e0 tempest-CreateVolumesFromImageTest-715748175 None] Lock "cinder-quobyte-512ee959-2e65-4de8-b6e1-c6c8be590e96" acquired by "delete_volume" :: waited 0.022s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[388bc1f8-cb44-43a7-a203-e055217e8d7b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-79298ef5-2fd7-499c-bea5-7f1b3f3a98e0 tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-512ee959-2e65-4de8-b6e1-c6c8be590e96 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:56 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-edd4afef-1c03-463c-8143-37bde4eac3ad tempest-CreateVolumesFromImageTest-715748175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.311s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-edd4afef-1c03-463c-8143-37bde4eac3ad tempest-CreateVolumesFromImageTest-715748175 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:01:56 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-edd4afef-1c03-463c-8143-37bde4eac3ad tempest-CreateVolumesFromImageTest-715748175 None] Deleted volume successfully. Nov 05 04:01:56 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-512ee959-2e65-4de8-b6e1-c6c8be590e96 Nov 05 04:01:56 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-edd4afef-1c03-463c-8143-37bde4eac3ad tempest-CreateVolumesFromImageTest-715748175 None] Lock "cinder-c094993d-492e-4373-9f98-0cf7c2bbd07c-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:56 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70" returned: 0 in 0.318s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.495s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Acquiring lock "cinder-quobyte-8d36edaf-dd72-4551-a227-9b292428ebad-4377d754-c768-45b2-b6e1-e8d2160c2f86" by "_create_volume_from_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Lock "cinder-quobyte-8d36edaf-dd72-4551-a227-9b292428ebad-4377d754-c768-45b2-b6e1-e8d2160c2f86" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Creating volume 4377d754-c768-45b2-b6e1-e8d2160c2f86 from snapshot 8d36edaf-dd72-4551-a227-9b292428ebad {{(pid=87109) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Acquiring lock "cinder-quobyte-4377d754-c768-45b2-b6e1-e8d2160c2f86" by "_copy_volume_from_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Attempting download of 89fad89f-caa6-4975-af33-b2334ccafe35 ((None, [{'url': 'file:///opt/stack/data/glance/images/89fad89f-caa6-4975-af33-b2334ccafe35', 'metadata': {}}])) to volume 8a57e0bc-67d0-42bf-8094-f6ac4ea78e70. {{(pid=87109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Lock "cinder-quobyte-4377d754-c768-45b2-b6e1-e8d2160c2f86" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] snapshot: 8d36edaf-dd72-4551-a227-9b292428ebad, volume: 4377d754-c768-45b2-b6e1-e8d2160c2f86, {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9a0e7b-5242-4fc9-a4ee-6ee6487dd066]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf98682-3f0c-472b-b530-8a2c6a95e4a4]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89fad89f-caa6-4975-af33-b2334ccafe35_707oi3wd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bfc23ef5-0b0b-49c2-bae9-bd96d3442007 tempest-CinderUnicodeTest-1477526589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:56 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-79298ef5-2fd7-499c-bea5-7f1b3f3a98e0 tempest-CreateVolumesFromImageTest-715748175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-512ee959-2e65-4de8-b6e1-c6c8be590e96" returned: 0 in 0.437s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-79298ef5-2fd7-499c-bea5-7f1b3f3a98e0 tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-512ee959-2e65-4de8-b6e1-c6c8be590e96 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:56 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89fad89f-caa6-4975-af33-b2334ccafe35_707oi3wd Nov 05 04:01:56 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:56 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-512ee959-2e65-4de8-b6e1-c6c8be590e96 Nov 05 04:01:56 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:56 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad Nov 05 04:01:56 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:57 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89fad89f-caa6-4975-af33-b2334ccafe35_707oi3wd" returned: 0 in 0.362s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fad89f-caa6-4975-af33-b2334ccafe35_707oi3wd {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:57 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-79298ef5-2fd7-499c-bea5-7f1b3f3a98e0 tempest-CreateVolumesFromImageTest-715748175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-512ee959-2e65-4de8-b6e1-c6c8be590e96" returned: 0 in 0.286s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-79298ef5-2fd7-499c-bea5-7f1b3f3a98e0 tempest-CreateVolumesFromImageTest-715748175 None] Lock "cinder-quobyte-512ee959-2e65-4de8-b6e1-c6c8be590e96" released by "delete_volume" :: held 0.789s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:57 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad" returned: 0 in 0.423s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7c05c96-db74-49f8-8c20-14aef022ace6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3569e973-a0f1-4d0d-a4fe-95d12f243d6a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-79298ef5-2fd7-499c-bea5-7f1b3f3a98e0 tempest-CreateVolumesFromImageTest-715748175 None] Created reservations ['ee891db9-ed67-4741-ab34-5500fdba670a', 'ad32730d-c0c5-4527-bef2-eae3f8f0127d', '36676bbf-859b-42b4-bde9-dc897ddff307', '80e6b705-64f3-4f2e-9ee3-871ad89d0632'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:01:57 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fad89f-caa6-4975-af33-b2334ccafe35_707oi3wd Nov 05 04:01:57 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-79298ef5-2fd7-499c-bea5-7f1b3f3a98e0 tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-79298ef5-2fd7-499c-bea5-7f1b3f3a98e0 tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-79298ef5-2fd7-499c-bea5-7f1b3f3a98e0 tempest-CreateVolumesFromImageTest-715748175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-79298ef5-2fd7-499c-bea5-7f1b3f3a98e0 tempest-CreateVolumesFromImageTest-715748175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-79298ef5-2fd7-499c-bea5-7f1b3f3a98e0 tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-79298ef5-2fd7-499c-bea5-7f1b3f3a98e0 tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:57 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6 Nov 05 04:01:57 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:57 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:01:57 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a428bee0-30ec-4699-bb4e-6e73ff2ebce5 tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "cinder-b9930057-8ae5-41e4-aa94-9e95adb360f1-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a428bee0-30ec-4699-bb4e-6e73ff2ebce5 tempest-CreateVolumesFromImageTest-715748175 None] Lock "cinder-b9930057-8ae5-41e4-aa94-9e95adb360f1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:57 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fad89f-caa6-4975-af33-b2334ccafe35_707oi3wd" returned: 1 in 0.440s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89fad89f-caa6-4975-af33-b2334ccafe35_707oi3wd' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3f8893-7e96-4cfe-a696-467aba79b7dc]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:57 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-79298ef5-2fd7-499c-bea5-7f1b3f3a98e0 tempest-CreateVolumesFromImageTest-715748175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.292s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-79298ef5-2fd7-499c-bea5-7f1b3f3a98e0 tempest-CreateVolumesFromImageTest-715748175 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:01:57 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-79298ef5-2fd7-499c-bea5-7f1b3f3a98e0 tempest-CreateVolumesFromImageTest-715748175 None] Deleted volume successfully. Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a428bee0-30ec-4699-bb4e-6e73ff2ebce5 tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "cinder-quobyte-b9930057-8ae5-41e4-aa94-9e95adb360f1" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:57 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a428bee0-30ec-4699-bb4e-6e73ff2ebce5 tempest-CreateVolumesFromImageTest-715748175 None] Lock "cinder-quobyte-b9930057-8ae5-41e4-aa94-9e95adb360f1" acquired by "delete_volume" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-79298ef5-2fd7-499c-bea5-7f1b3f3a98e0 tempest-CreateVolumesFromImageTest-715748175 None] Lock "cinder-512ee959-2e65-4de8-b6e1-c6c8be590e96-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6" returned: 0 in 0.465s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6 {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Creating direct copy from snapshot {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG cinder.utils [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Path /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4377d754-c768-45b2-b6e1-e8d2160c2f86 not found in is_blk_device check {{(pid=87109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4377d754-c768-45b2-b6e1-e8d2160c2f86 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b17167-dd27-42a0-9971-1d42eb79180c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a428bee0-30ec-4699-bb4e-6e73ff2ebce5 tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b9930057-8ae5-41e4-aa94-9e95adb360f1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:57 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4377d754-c768-45b2-b6e1-e8d2160c2f86 Nov 05 04:01:57 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:57 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD Nov 05 04:01:57 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:57 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b9930057-8ae5-41e4-aa94-9e95adb360f1 Nov 05 04:01:57 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:57 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:58 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a428bee0-30ec-4699-bb4e-6e73ff2ebce5 tempest-CreateVolumesFromImageTest-715748175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b9930057-8ae5-41e4-aa94-9e95adb360f1" returned: 0 in 0.410s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a428bee0-30ec-4699-bb4e-6e73ff2ebce5 tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b9930057-8ae5-41e4-aa94-9e95adb360f1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:58 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD Nov 05 04:01:58 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:58 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b9930057-8ae5-41e4-aa94-9e95adb360f1 Nov 05 04:01:58 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:58 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD" returned: 1 in 0.447s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] 89fad89f-caa6-4975-af33-b2334ccafe35 was raw, converting to qcow2 {{(pid=87109) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:58 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70 Nov 05 04:01:58 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:58 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a428bee0-30ec-4699-bb4e-6e73ff2ebce5 tempest-CreateVolumesFromImageTest-715748175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b9930057-8ae5-41e4-aa94-9e95adb360f1" returned: 0 in 0.461s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a428bee0-30ec-4699-bb4e-6e73ff2ebce5 tempest-CreateVolumesFromImageTest-715748175 None] Lock "cinder-quobyte-b9930057-8ae5-41e4-aa94-9e95adb360f1" released by "delete_volume" :: held 0.983s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:58 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:01:58 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-a428bee0-30ec-4699-bb4e-6e73ff2ebce5 tempest-CreateVolumesFromImageTest-715748175 None] Created reservations ['1cb85ff2-1bbd-44af-9f3e-f1282efadd0d', '89d43d67-9137-4975-84eb-80c6a1efecda', 'c0dedc08-8b3d-4f77-8bb3-52ff87904d3f', '851e4462-98a4-4cca-8496-b8f8fca37d59'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a428bee0-30ec-4699-bb4e-6e73ff2ebce5 tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a428bee0-30ec-4699-bb4e-6e73ff2ebce5 tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a428bee0-30ec-4699-bb4e-6e73ff2ebce5 tempest-CreateVolumesFromImageTest-715748175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a428bee0-30ec-4699-bb4e-6e73ff2ebce5 tempest-CreateVolumesFromImageTest-715748175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a428bee0-30ec-4699-bb4e-6e73ff2ebce5 tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:01:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a428bee0-30ec-4699-bb4e-6e73ff2ebce5 tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:58 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:01:58 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:59 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.477s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:59 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:01:59 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:01:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 28 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 04:01:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 04:01:59 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a428bee0-30ec-4699-bb4e-6e73ff2ebce5 tempest-CreateVolumesFromImageTest-715748175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.438s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:59 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-a428bee0-30ec-4699-bb4e-6e73ff2ebce5 tempest-CreateVolumesFromImageTest-715748175 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:01:59 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-a428bee0-30ec-4699-bb4e-6e73ff2ebce5 tempest-CreateVolumesFromImageTest-715748175 None] Deleted volume successfully. Nov 05 04:01:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a428bee0-30ec-4699-bb4e-6e73ff2ebce5 tempest-CreateVolumesFromImageTest-715748175 None] Lock "cinder-b9930057-8ae5-41e4-aa94-9e95adb360f1-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:01:59 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Nov 05 04:01:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70" returned: 0 in 1.128s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:01:59 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_89fad89f-caa6-4975-af33-b2334ccafe35_ukhnmn43devstack@QuobyteHD, size 0.00 MB, duration 1.13 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70 {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 04:01:59 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 04:01:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:01:59 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70 1G Nov 05 04:01:59 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:01:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b8d3a469-09d8-4beb-bb06-59f02845730f tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "cinder-b86389f0-b455-485d-9fb0-541982ecd779-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:01:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b8d3a469-09d8-4beb-bb06-59f02845730f tempest-CreateVolumesFromImageTest-715748175 None] Lock "cinder-b86389f0-b455-485d-9fb0-541982ecd779-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b8d3a469-09d8-4beb-bb06-59f02845730f tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "cinder-quobyte-b86389f0-b455-485d-9fb0-541982ecd779" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b8d3a469-09d8-4beb-bb06-59f02845730f tempest-CreateVolumesFromImageTest-715748175 None] Lock "cinder-quobyte-b86389f0-b455-485d-9fb0-541982ecd779" acquired by "delete_volume" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:00 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2aaa636-da7f-44e7-807e-840d26c2101b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b8d3a469-09d8-4beb-bb06-59f02845730f tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b86389f0-b455-485d-9fb0-541982ecd779 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:00 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70 1G" returned: 0 in 0.683s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:00 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Downloaded image 89fad89f-caa6-4975-af33-b2334ccafe35 ((None, [{'url': 'file:///opt/stack/data/glance/images/89fad89f-caa6-4975-af33-b2334ccafe35', 'metadata': {}}])) to volume 8a57e0bc-67d0-42bf-8094-f6ac4ea78e70 successfully. {{(pid=87109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 05 04:02:00 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Temporary image 89fad89f-caa6-4975-af33-b2334ccafe35 for user 7c3a778c91264b129f8f71e303c64402 is deleted. {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 05 04:02:00 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Marking volume 8a57e0bc-67d0-42bf-8094-f6ac4ea78e70 as bootable. {{(pid=87109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 05 04:02:00 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Copying metadata from image 89fad89f-caa6-4975-af33-b2334ccafe35 to 8a57e0bc-67d0-42bf-8094-f6ac4ea78e70. {{(pid=87109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 04:02:00 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Creating volume glance metadata for volume 8a57e0bc-67d0-42bf-8094-f6ac4ea78e70 backed by image 89fad89f-caa6-4975-af33-b2334ccafe35 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '89fad89f-caa6-4975-af33-b2334ccafe35', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5687d6fd474848139c2a9775adc6e500', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 04:02:00 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b86389f0-b455-485d-9fb0-541982ecd779 Nov 05 04:02:00 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:00 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e116481d-704e-4882-abd2-329ffacb6a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70', 'volume_size': 1, 'image_id': '89fad89f-caa6-4975-af33-b2334ccafe35', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89fad89f-caa6-4975-af33-b2334ccafe35', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5687d6fd474848139c2a9775adc6e500', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9096546d198d40b7904ee621db1354dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1dec116d760ff555294de34635143f03b53bf40eeb42335ffd9f506bf7d520df426ff1ba9cad2a19ce76c6a05214c0ba05b950807c17ff7c34808b17aa386899', 'id': '89fad89f-caa6-4975-af33-b2334ccafe35', 'created_at': datetime.datetime(2026, 11, 5, 3, 1, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 1, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89fad89f-caa6-4975-af33-b2334ccafe35/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:00 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6e5e93-1f1b-4603-9093-6641d6deabaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:00 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Volume volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70 (8a57e0bc-67d0-42bf-8094-f6ac4ea78e70): created successfully Nov 05 04:02:00 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb6e5e93-1f1b-4603-9093-6641d6deabaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:00 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Flow 'volume_create_manager' (250efbf9-72c2-479c-aef6-c66c466a5e30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:00 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-9f5cb00e-b27a-45ed-9d00-2e677d7099f1 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Created volume successfully. Nov 05 04:02:00 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b8d3a469-09d8-4beb-bb06-59f02845730f tempest-CreateVolumesFromImageTest-715748175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b86389f0-b455-485d-9fb0-541982ecd779" returned: 0 in 0.637s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b8d3a469-09d8-4beb-bb06-59f02845730f tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b86389f0-b455-485d-9fb0-541982ecd779 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:00 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b86389f0-b455-485d-9fb0-541982ecd779 Nov 05 04:02:00 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:01 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b8d3a469-09d8-4beb-bb06-59f02845730f tempest-CreateVolumesFromImageTest-715748175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b86389f0-b455-485d-9fb0-541982ecd779" returned: 0 in 0.501s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b8d3a469-09d8-4beb-bb06-59f02845730f tempest-CreateVolumesFromImageTest-715748175 None] Lock "cinder-quobyte-b86389f0-b455-485d-9fb0-541982ecd779" released by "delete_volume" :: held 1.219s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:01 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-b8d3a469-09d8-4beb-bb06-59f02845730f tempest-CreateVolumesFromImageTest-715748175 None] Created reservations ['7e112d6f-78fe-4227-8e6e-c7548dd037c5', '79633a55-81c6-44c6-837c-558a1e6f6624', '50aa9292-206e-46de-a50e-506767584b0b', 'b382f96e-2659-46fe-873d-7dc9c415ea01'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b8d3a469-09d8-4beb-bb06-59f02845730f tempest-CreateVolumesFromImageTest-715748175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b8d3a469-09d8-4beb-bb06-59f02845730f tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b8d3a469-09d8-4beb-bb06-59f02845730f tempest-CreateVolumesFromImageTest-715748175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b8d3a469-09d8-4beb-bb06-59f02845730f tempest-CreateVolumesFromImageTest-715748175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b8d3a469-09d8-4beb-bb06-59f02845730f tempest-CreateVolumesFromImageTest-715748175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b8d3a469-09d8-4beb-bb06-59f02845730f tempest-CreateVolumesFromImageTest-715748175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:01 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:01 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4d616dce-ede0-42c0-af69-0f341cc4e0a3 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Acquiring lock "cinder-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4d616dce-ede0-42c0-af69-0f341cc4e0a3 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Lock "cinder-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4d616dce-ede0-42c0-af69-0f341cc4e0a3 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Acquiring lock "cinder-quobyte-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4d616dce-ede0-42c0-af69-0f341cc4e0a3 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Lock "cinder-quobyte-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70" acquired by "delete_volume" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:01 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[381012fc-47cb-40a1-9e00-21c383094787]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d616dce-ede0-42c0-af69-0f341cc4e0a3 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:02 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b8d3a469-09d8-4beb-bb06-59f02845730f tempest-CreateVolumesFromImageTest-715748175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.540s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:02 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-b8d3a469-09d8-4beb-bb06-59f02845730f tempest-CreateVolumesFromImageTest-715748175 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:02 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b8d3a469-09d8-4beb-bb06-59f02845730f tempest-CreateVolumesFromImageTest-715748175 None] Deleted volume successfully. Nov 05 04:02:02 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70 Nov 05 04:02:02 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:02 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b8d3a469-09d8-4beb-bb06-59f02845730f tempest-CreateVolumesFromImageTest-715748175 None] Lock "cinder-b86389f0-b455-485d-9fb0-541982ecd779-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:02 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d616dce-ede0-42c0-af69-0f341cc4e0a3 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70" returned: 0 in 0.675s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d616dce-ede0-42c0-af69-0f341cc4e0a3 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:02 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70 Nov 05 04:02:02 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:02 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d616dce-ede0-42c0-af69-0f341cc4e0a3 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70" returned: 0 in 0.457s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:03 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4d616dce-ede0-42c0-af69-0f341cc4e0a3 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Lock "cinder-quobyte-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70" released by "delete_volume" :: held 1.217s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:03 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-4d616dce-ede0-42c0-af69-0f341cc4e0a3 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Created reservations ['c97eff45-7b38-45e9-9dc0-77bfa737a1ee', '033110a4-418c-418d-ae52-4d4ca64afb52', 'd040b368-5de2-4c0b-8451-f0ccd117df25', '567a4764-9dd9-468e-ba41-89e3503eaf0c'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4d616dce-ede0-42c0-af69-0f341cc4e0a3 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4d616dce-ede0-42c0-af69-0f341cc4e0a3 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4d616dce-ede0-42c0-af69-0f341cc4e0a3 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4d616dce-ede0-42c0-af69-0f341cc4e0a3 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4d616dce-ede0-42c0-af69-0f341cc4e0a3 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d616dce-ede0-42c0-af69-0f341cc4e0a3 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:03 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:03 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:03 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d616dce-ede0-42c0-af69-0f341cc4e0a3 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.576s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:03 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-4d616dce-ede0-42c0-af69-0f341cc4e0a3 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:03 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-4d616dce-ede0-42c0-af69-0f341cc4e0a3 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Deleted volume successfully. Nov 05 04:02:03 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4d616dce-ede0-42c0-af69-0f341cc4e0a3 tempest-VolumeAndVolumeTypeFromImageTest-845958218 None] Lock "cinder-8a57e0bc-67d0-42bf-8094-f6ac4ea78e70-delete_volume" released by "delete_volume" :: held 2.298s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:05 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4377d754-c768-45b2-b6e1-e8d2160c2f86" returned: 0 in 7.769s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:05 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Image conversion details: src /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6, size 1024.00 MB, duration 7.77 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4377d754-c768-45b2-b6e1-e8d2160c2f86 {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 04:02:05 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Converted 1024.00 MB image at 131.78 MB/s Nov 05 04:02:05 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4377d754-c768-45b2-b6e1-e8d2160c2f86 is being set with open permissions: ugo+rw Nov 05 04:02:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4377d754-c768-45b2-b6e1-e8d2160c2f86 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:05 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4377d754-c768-45b2-b6e1-e8d2160c2f86 Nov 05 04:02:05 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:05 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4377d754-c768-45b2-b6e1-e8d2160c2f86" returned: 0 in 0.263s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:05 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Lock "cinder-quobyte-4377d754-c768-45b2-b6e1-e8d2160c2f86" released by "_copy_volume_from_snapshot" :: held 9.047s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:05 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Lock "cinder-quobyte-8d36edaf-dd72-4551-a227-9b292428ebad-4377d754-c768-45b2-b6e1-e8d2160c2f86" released by "_create_volume_from_snapshot" :: held 9.152s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.178s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bfc23ef5-0b0b-49c2-bae9-bd96d3442007 tempest-CinderUnicodeTest-1477526589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.954s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-bfc23ef5-0b0b-49c2-bae9-bd96d3442007 tempest-CinderUnicodeTest-1477526589 None] Creating offline snapshot 6277c5a7-aa19-4662-820f-6cf22b08aeec of volume 6ea388ef-f298-43e7-9186-7768811048a1 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:02:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553d6d3d-6765-4081-91fa-df33341e2ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4377d754-c768-45b2-b6e1-e8d2160c2f86', 'volume_size': 1, 'snapshot_id': '8d36edaf-dd72-4551-a227-9b292428ebad'}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94103203-cd10-4c24-af3d-0fa7d9c68d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:05 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97e88bc-cb70-4241-a9c4-65d41fa7875e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bfc23ef5-0b0b-49c2-bae9-bd96d3442007 tempest-CinderUnicodeTest-1477526589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:05 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Volume volume-4377d754-c768-45b2-b6e1-e8d2160c2f86 (4377d754-c768-45b2-b6e1-e8d2160c2f86): created successfully Nov 05 04:02:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94103203-cd10-4c24-af3d-0fa7d9c68d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Flow 'volume_create_manager' (2dbf4319-5982-4212-9db6-3193526b4e1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:05 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b6ee94ab-7b72-4de0-bcae-03e60f9e1b9a tempest-VolumeDependencyTests-829250185 None] Created volume successfully. Nov 05 04:02:06 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1 Nov 05 04:02:06 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:06 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bfc23ef5-0b0b-49c2-bae9-bd96d3442007 tempest-CinderUnicodeTest-1477526589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1" returned: 0 in 0.417s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bfc23ef5-0b0b-49c2-bae9-bd96d3442007 tempest-CinderUnicodeTest-1477526589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.6277c5a7-aa19-4662-820f-6cf22b08aeec 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:06 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.6277c5a7-aa19-4662-820f-6cf22b08aeec 1G Nov 05 04:02:06 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:06 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bfc23ef5-0b0b-49c2-bae9-bd96d3442007 tempest-CinderUnicodeTest-1477526589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.6277c5a7-aa19-4662-820f-6cf22b08aeec 1G" returned: 0 in 0.477s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bfc23ef5-0b0b-49c2-bae9-bd96d3442007 tempest-CinderUnicodeTest-1477526589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ea388ef-f298-43e7-9186-7768811048a1 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.6277c5a7-aa19-4662-820f-6cf22b08aeec {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:06 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ea388ef-f298-43e7-9186-7768811048a1 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.6277c5a7-aa19-4662-820f-6cf22b08aeec Nov 05 04:02:06 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] Acquiring lock "cinder-8d36edaf-dd72-4551-a227-9b292428ebad-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] Lock "cinder-8d36edaf-dd72-4551-a227-9b292428ebad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] Acquiring lock "cinder-quobyte-f7c05c96-db74-49f8-8c20-14aef022ace6" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] Lock "cinder-quobyte-f7c05c96-db74-49f8-8c20-14aef022ace6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] Acquiring lock "cinder-quobyte-8d36edaf-dd72-4551-a227-9b292428ebad" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] Lock "cinder-quobyte-8d36edaf-dd72-4551-a227-9b292428ebad" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] Deleting offline snapshot 8d36edaf-dd72-4551-a227-9b292428ebad of volume f7c05c96-db74-49f8-8c20-14aef022ace6 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] snapshot_file for this snap is: volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:02:07 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b468979-6244-4a92-b7df-406f73a9550a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bfc23ef5-0b0b-49c2-bae9-bd96d3442007 tempest-CinderUnicodeTest-1477526589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ea388ef-f298-43e7-9186-7768811048a1 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.6277c5a7-aa19-4662-820f-6cf22b08aeec" returned: 0 in 0.449s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:07 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-bfc23ef5-0b0b-49c2-bae9-bd96d3442007 tempest-CinderUnicodeTest-1477526589 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.6277c5a7-aa19-4662-820f-6cf22b08aeec is being set with open permissions: ugo+rw Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bfc23ef5-0b0b-49c2-bae9-bd96d3442007 tempest-CinderUnicodeTest-1477526589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.6277c5a7-aa19-4662-820f-6cf22b08aeec {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:02:07 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.6277c5a7-aa19-4662-820f-6cf22b08aeec Nov 05 04:02:07 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Flow 'volume_create_manager' (e157adb2-0aeb-4223-9e8b-ec6fb8ac08b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc56273-2b84-4375-87f7-0e1d89571ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc56273-2b84-4375-87f7-0e1d89571ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-958657025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751dcd6c-418e-4b57-83f1-f624bddc7d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a97b52014f454cf9b86435a19eb75db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:07Z,use_quota=True,user_id='a3246ec95b4e4a7886249c19592b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599c2b03-edd4-478b-aac0-80e3a56ccd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (599c2b03-edd4-478b-aac0-80e3a56ccd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c57114-56bf-45e9-a063-950e319268c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c57114-56bf-45e9-a063-950e319268c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '751dcd6c-418e-4b57-83f1-f624bddc7d77', 'volume_name': 'volume-751dcd6c-418e-4b57-83f1-f624bddc7d77', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:07 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad Nov 05 04:02:07 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c26bb04-92ea-4591-9391-1c77f1153472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c26bb04-92ea-4591-9391-1c77f1153472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa56198-f615-4ca3-ac62-514d1257a598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:07 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Volume 751dcd6c-418e-4b57-83f1-f624bddc7d77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-751dcd6c-418e-4b57-83f1-f624bddc7d77', 'volume_size': 1} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:07 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bfc23ef5-0b0b-49c2-bae9-bd96d3442007 tempest-CinderUnicodeTest-1477526589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.6277c5a7-aa19-4662-820f-6cf22b08aeec" returned: 0 in 0.282s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bfc23ef5-0b0b-49c2-bae9-bd96d3442007 tempest-CinderUnicodeTest-1477526589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:07 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.info Nov 05 04:02:07 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:07 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad" returned: 0 in 0.395s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7c05c96-db74-49f8-8c20-14aef022ace6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[662ae6e1-8cf1-4c91-b214-93b9d7467b32]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:07 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6 Nov 05 04:02:07 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:07 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bfc23ef5-0b0b-49c2-bae9-bd96d3442007 tempest-CinderUnicodeTest-1477526589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.info" returned: 0 in 0.276s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:07 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-bfc23ef5-0b0b-49c2-bae9-bd96d3442007 tempest-CinderUnicodeTest-1477526589 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.info is being set with open permissions: ugo+rw Nov 05 04:02:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bfc23ef5-0b0b-49c2-bae9-bd96d3442007 tempest-CinderUnicodeTest-1477526589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:07 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.info Nov 05 04:02:07 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:08 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bfc23ef5-0b0b-49c2-bae9-bd96d3442007 tempest-CinderUnicodeTest-1477526589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.info" returned: 0 in 0.263s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bfc23ef5-0b0b-49c2-bae9-bd96d3442007 tempest-CinderUnicodeTest-1477526589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.342s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.800s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-958657025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751dcd6c-418e-4b57-83f1-f624bddc7d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a97b52014f454cf9b86435a19eb75db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:07Z,use_quota=True,user_id='a3246ec95b4e4a7886249c19592b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Creating volume 751dcd6c-418e-4b57-83f1-f624bddc7d77 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:02:08 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-751dcd6c-418e-4b57-83f1-f624bddc7d77 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:08 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-751dcd6c-418e-4b57-83f1-f624bddc7d77 1073741824 Nov 05 04:02:08 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:08 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-bfc23ef5-0b0b-49c2-bae9-bd96d3442007 tempest-CinderUnicodeTest-1477526589 None] Create snapshot completed successfully Nov 05 04:02:08 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6" returned: 0 in 0.588s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:08 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad Nov 05 04:02:08 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] Acquiring lock "cinder-6277c5a7-aa19-4662-820f-6cf22b08aeec-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] Lock "cinder-6277c5a7-aa19-4662-820f-6cf22b08aeec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] Acquiring lock "cinder-quobyte-6ea388ef-f298-43e7-9186-7768811048a1" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] Lock "cinder-quobyte-6ea388ef-f298-43e7-9186-7768811048a1" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] Acquiring lock "cinder-quobyte-6277c5a7-aa19-4662-820f-6cf22b08aeec" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] Lock "cinder-quobyte-6277c5a7-aa19-4662-820f-6cf22b08aeec" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] Deleting offline snapshot 6277c5a7-aa19-4662-820f-6cf22b08aeec of volume 6ea388ef-f298-43e7-9186-7768811048a1 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] snapshot_file for this snap is: volume-6ea388ef-f298-43e7-9186-7768811048a1.6277c5a7-aa19-4662-820f-6cf22b08aeec {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c414b20b-843b-47ec-bcb0-7dfc6dfd126d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.6277c5a7-aa19-4662-820f-6cf22b08aeec {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:08 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad" returned: 0 in 0.458s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:08 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-751dcd6c-418e-4b57-83f1-f624bddc7d77 1073741824" returned: 0 in 0.555s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:08 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.6277c5a7-aa19-4662-820f-6cf22b08aeec Nov 05 04:02:08 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:08 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad Nov 05 04:02:08 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-751dcd6c-418e-4b57-83f1-f624bddc7d77 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:08 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-751dcd6c-418e-4b57-83f1-f624bddc7d77 Nov 05 04:02:08 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:08 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6.8d36edaf-dd72-4551-a227-9b292428ebad" returned: 0 in 0.297s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:09 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:09 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-751dcd6c-418e-4b57-83f1-f624bddc7d77" returned: 0 in 0.287s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] Lock "cinder-quobyte-8d36edaf-dd72-4551-a227-9b292428ebad" released by "_delete_snapshot" :: held 1.886s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.6277c5a7-aa19-4662-820f-6cf22b08aeec" returned: 0 in 0.450s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ea388ef-f298-43e7-9186-7768811048a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] Lock "cinder-quobyte-f7c05c96-db74-49f8-8c20-14aef022ace6" released by "delete_snapshot" :: held 1.944s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa56198-f615-4ca3-ac62-514d1257a598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-751dcd6c-418e-4b57-83f1-f624bddc7d77', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e813f7a-f001-4de3-8305-51bf73abd215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07eaf00-f503-4ac2-bd9b-6c31e4f07278]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:09 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Volume volume-751dcd6c-418e-4b57-83f1-f624bddc7d77 (751dcd6c-418e-4b57-83f1-f624bddc7d77): created successfully Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e813f7a-f001-4de3-8305-51bf73abd215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Flow 'volume_create_manager' (e157adb2-0aeb-4223-9e8b-ec6fb8ac08b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:09 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-7b2fb584-5298-457a-8519-11e736b0dadd tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Created volume successfully. Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] Created reservations ['fef7ec0e-9288-4e03-90e2-5feef2fc1233', 'b2010e12-1e51-47a3-96c2-097f855708ee', '0b258ba5-fe7c-43a1-8bbc-6dcd89e5a2bd', 'aa9ad489-8967-4bdc-b920-51de2fdc902f'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:09 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1 Nov 05 04:02:09 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:09 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] Delete snapshot completed successfully. Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a9152a99-54c5-479f-a452-ad03c8f5e232 tempest-VolumeDependencyTests-829250185 None] Lock "cinder-8d36edaf-dd72-4551-a227-9b292428ebad-delete_snapshot" released by "delete_snapshot" :: held 2.178s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:02:09 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Flow 'volume_create_manager' (3d149aa2-643d-44ad-9c79-1548466cef84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35e3fcd-9dd8-41d6-ad16-994afcfb5473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1" returned: 0 in 0.465s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.6277c5a7-aa19-4662-820f-6cf22b08aeec {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d35e3fcd-9dd8-41d6-ad16-994afcfb5473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1238217194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f4153b-ebbc-487a-8013-3e6cb534148e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93c69acbac24c06a8467c24d2935536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:09Z,use_quota=True,user_id='0927b2fd243a4a3592e1eb4df07e5ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:09 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.6277c5a7-aa19-4662-820f-6cf22b08aeec Nov 05 04:02:09 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15eca10-6af6-4a9a-9fc2-c33a7a933c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15eca10-6af6-4a9a-9fc2-c33a7a933c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574f1b75-a2bf-4b9a-899e-26dd96203ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574f1b75-a2bf-4b9a-899e-26dd96203ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0f4153b-ebbc-487a-8013-3e6cb534148e', 'volume_name': 'volume-e0f4153b-ebbc-487a-8013-3e6cb534148e', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43fbc8b9-1d22-470b-99f8-bc8ec61785a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43fbc8b9-1d22-470b-99f8-bc8ec61785a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf032589-084d-4bd0-9f30-0df89de84b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:09 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Volume e0f4153b-ebbc-487a-8013-3e6cb534148e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0f4153b-ebbc-487a-8013-3e6cb534148e', 'volume_size': 1} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1238217194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f4153b-ebbc-487a-8013-3e6cb534148e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93c69acbac24c06a8467c24d2935536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:09Z,use_quota=True,user_id='0927b2fd243a4a3592e1eb4df07e5ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Creating volume e0f4153b-ebbc-487a-8013-3e6cb534148e {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:02:09 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:09 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e 1073741824 Nov 05 04:02:09 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:09 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.6277c5a7-aa19-4662-820f-6cf22b08aeec" returned: 0 in 0.315s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.6277c5a7-aa19-4662-820f-6cf22b08aeec {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:09 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.6277c5a7-aa19-4662-820f-6cf22b08aeec Nov 05 04:02:09 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:10 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e 1073741824" returned: 0 in 0.402s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:10 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e Nov 05 04:02:10 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:10 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1.6277c5a7-aa19-4662-820f-6cf22b08aeec" returned: 0 in 0.271s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] Lock "cinder-quobyte-6277c5a7-aa19-4662-820f-6cf22b08aeec" released by "_delete_snapshot" :: held 1.652s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] Lock "cinder-quobyte-6ea388ef-f298-43e7-9186-7768811048a1" released by "delete_snapshot" :: held 1.680s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] Created reservations ['b7767f1d-82a6-4266-a6a1-5fd1d6173d2f', '5a7eb2d7-edcb-4a74-881d-f8c4cafac844', '0c63d055-f1c0-4e91-912a-5b2b1370aa9f', 'b329b0c4-1a53-4082-a80e-02376a828969'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-803f93cc-5cd8-464d-a9cb-757fd96d9dd6 tempest-VolumeDependencyTests-829250185 None] Acquiring lock "cinder-f7c05c96-db74-49f8-8c20-14aef022ace6-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-803f93cc-5cd8-464d-a9cb-757fd96d9dd6 tempest-VolumeDependencyTests-829250185 None] Lock "cinder-f7c05c96-db74-49f8-8c20-14aef022ace6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:10 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e" returned: 0 in 0.304s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:10 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] Delete snapshot completed successfully. Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf032589-084d-4bd0-9f30-0df89de84b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0f4153b-ebbc-487a-8013-3e6cb534148e', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08ffcdc-9b25-4630-88bf-373f7260911a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-803f93cc-5cd8-464d-a9cb-757fd96d9dd6 tempest-VolumeDependencyTests-829250185 None] Acquiring lock "cinder-quobyte-f7c05c96-db74-49f8-8c20-14aef022ace6" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-961a574b-d754-44ac-8b7d-b352f6384b99 tempest-CinderUnicodeTest-1477526589 None] Lock "cinder-6277c5a7-aa19-4662-820f-6cf22b08aeec-delete_snapshot" released by "delete_snapshot" :: held 1.923s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:10 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Volume volume-e0f4153b-ebbc-487a-8013-3e6cb534148e (e0f4153b-ebbc-487a-8013-3e6cb534148e): created successfully Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08ffcdc-9b25-4630-88bf-373f7260911a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Flow 'volume_create_manager' (3d149aa2-643d-44ad-9c79-1548466cef84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-803f93cc-5cd8-464d-a9cb-757fd96d9dd6 tempest-VolumeDependencyTests-829250185 None] Lock "cinder-quobyte-f7c05c96-db74-49f8-8c20-14aef022ace6" acquired by "delete_volume" :: waited 0.039s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:10 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-753043c1-49c5-4585-9375-120fbbd02ed8 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Created volume successfully. Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2f11e8-f37f-4e85-9ddf-d78081353e54]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-803f93cc-5cd8-464d-a9cb-757fd96d9dd6 tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:10 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6 Nov 05 04:02:10 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a18ec607-c002-4020-a30a-57563ccd451c tempest-CinderUnicodeTest-1477526589 None] Acquiring lock "cinder-6ea388ef-f298-43e7-9186-7768811048a1-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a18ec607-c002-4020-a30a-57563ccd451c tempest-CinderUnicodeTest-1477526589 None] Lock "cinder-6ea388ef-f298-43e7-9186-7768811048a1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a18ec607-c002-4020-a30a-57563ccd451c tempest-CinderUnicodeTest-1477526589 None] Acquiring lock "cinder-quobyte-6ea388ef-f298-43e7-9186-7768811048a1" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a18ec607-c002-4020-a30a-57563ccd451c tempest-CinderUnicodeTest-1477526589 None] Lock "cinder-quobyte-6ea388ef-f298-43e7-9186-7768811048a1" acquired by "delete_volume" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0facb0a3-1ca5-4b31-a0ff-82be5eb69c5e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a18ec607-c002-4020-a30a-57563ccd451c tempest-CinderUnicodeTest-1477526589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Flow 'volume_create_manager' (f2010a2c-b36c-450d-b858-4c3401e97018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cb76ab-ef84-472c-9ee7-29be7b6407aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cb76ab-ef84-472c-9ee7-29be7b6407aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1281827259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df28b4d-d1ad-4c4a-807d-77ad00534e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a97b52014f454cf9b86435a19eb75db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:11Z,use_quota=True,user_id='a3246ec95b4e4a7886249c19592b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4453e9d1-b0f5-413d-934c-e422fad49670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4453e9d1-b0f5-413d-934c-e422fad49670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee60cab-c053-47fa-84e8-e6ad3074f461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee60cab-c053-47fa-84e8-e6ad3074f461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2df28b4d-d1ad-4c4a-807d-77ad00534e29', 'volume_name': 'volume-2df28b4d-d1ad-4c4a-807d-77ad00534e29', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d08c07-b373-4172-bfdf-f7bd64f55b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d08c07-b373-4172-bfdf-f7bd64f55b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:11 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1 Nov 05 04:02:11 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e874d51-9644-41ed-b646-a9b0054deab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:11 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Volume 2df28b4d-d1ad-4c4a-807d-77ad00534e29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2df28b4d-d1ad-4c4a-807d-77ad00534e29', 'volume_size': 1} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1281827259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2df28b4d-d1ad-4c4a-807d-77ad00534e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a97b52014f454cf9b86435a19eb75db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:11Z,use_quota=True,user_id='a3246ec95b4e4a7886249c19592b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Creating volume 2df28b4d-d1ad-4c4a-807d-77ad00534e29 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:02:11 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2df28b4d-d1ad-4c4a-807d-77ad00534e29 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:11 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2df28b4d-d1ad-4c4a-807d-77ad00534e29 1073741824 Nov 05 04:02:11 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:11 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-803f93cc-5cd8-464d-a9cb-757fd96d9dd6 tempest-VolumeDependencyTests-829250185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6" returned: 0 in 0.635s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-803f93cc-5cd8-464d-a9cb-757fd96d9dd6 tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:11 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6 Nov 05 04:02:11 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:11 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a18ec607-c002-4020-a30a-57563ccd451c tempest-CinderUnicodeTest-1477526589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1" returned: 0 in 0.586s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a18ec607-c002-4020-a30a-57563ccd451c tempest-CinderUnicodeTest-1477526589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:11 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1 Nov 05 04:02:11 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:11 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-803f93cc-5cd8-464d-a9cb-757fd96d9dd6 tempest-VolumeDependencyTests-829250185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-f7c05c96-db74-49f8-8c20-14aef022ace6" returned: 0 in 0.389s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Flow 'volume_create_manager' (050da5a0-bfa3-4689-ae9b-e3dd94fc9d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ffc623-172e-4350-9f94-54b47fb27160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-803f93cc-5cd8-464d-a9cb-757fd96d9dd6 tempest-VolumeDependencyTests-829250185 None] Lock "cinder-quobyte-f7c05c96-db74-49f8-8c20-14aef022ace6" released by "delete_volume" :: held 1.166s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ffc623-172e-4350-9f94-54b47fb27160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-74263087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e58032-d0c9-47e7-b76d-7d5f21827182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a97b52014f454cf9b86435a19eb75db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:11Z,use_quota=True,user_id='a3246ec95b4e4a7886249c19592b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeff7561-b525-4f99-be11-1c5fad252293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeff7561-b525-4f99-be11-1c5fad252293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b1afb4f-a646-42a5-abcc-a88817735c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:11 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b1afb4f-a646-42a5-abcc-a88817735c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26e58032-d0c9-47e7-b76d-7d5f21827182', 'volume_name': 'volume-26e58032-d0c9-47e7-b76d-7d5f21827182', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bca7954-1149-430d-804a-fe2aa7796c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bca7954-1149-430d-804a-fe2aa7796c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7de84d5-fe16-46e0-b7ff-c8e8531ca471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:11 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Volume 26e58032-d0c9-47e7-b76d-7d5f21827182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26e58032-d0c9-47e7-b76d-7d5f21827182', 'volume_size': 1} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2df28b4d-d1ad-4c4a-807d-77ad00534e29 1073741824" returned: 0 in 0.687s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2df28b4d-d1ad-4c4a-807d-77ad00534e29 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:11 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2df28b4d-d1ad-4c4a-807d-77ad00534e29 Nov 05 04:02:11 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-803f93cc-5cd8-464d-a9cb-757fd96d9dd6 tempest-VolumeDependencyTests-829250185 None] Created reservations ['eaffe827-3a7f-409e-8744-53de2e5c6cd8', 'f049b5ca-2e9e-4658-8b68-32da71c828f2', '8f5ce786-f59b-48d5-b0a5-cf6788f6ecf3', '6188b6ac-2d8b-4375-8586-c437c80ca41b'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:11 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a18ec607-c002-4020-a30a-57563ccd451c tempest-CinderUnicodeTest-1477526589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6ea388ef-f298-43e7-9186-7768811048a1" returned: 0 in 0.440s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a18ec607-c002-4020-a30a-57563ccd451c tempest-CinderUnicodeTest-1477526589 None] Lock "cinder-quobyte-6ea388ef-f298-43e7-9186-7768811048a1" released by "delete_volume" :: held 1.158s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-803f93cc-5cd8-464d-a9cb-757fd96d9dd6 tempest-VolumeDependencyTests-829250185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-803f93cc-5cd8-464d-a9cb-757fd96d9dd6 tempest-VolumeDependencyTests-829250185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-803f93cc-5cd8-464d-a9cb-757fd96d9dd6 tempest-VolumeDependencyTests-829250185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-803f93cc-5cd8-464d-a9cb-757fd96d9dd6 tempest-VolumeDependencyTests-829250185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-803f93cc-5cd8-464d-a9cb-757fd96d9dd6 tempest-VolumeDependencyTests-829250185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-803f93cc-5cd8-464d-a9cb-757fd96d9dd6 tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:12 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:12 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-a18ec607-c002-4020-a30a-57563ccd451c tempest-CinderUnicodeTest-1477526589 None] Created reservations ['d206222e-b1ee-4106-aa6a-d6d223c04c9f', '5166aac4-f662-403f-90da-c54fb355aa22', 'ed5cdaf5-4d66-46a8-bbc6-58772a33f863', '6a858238-1c8d-4c8c-844f-e97e0e996bf8'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:12 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bebf20df-57c8-4350-afcf-d2154e78896c tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2df28b4d-d1ad-4c4a-807d-77ad00534e29" returned: 0 in 0.395s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.489s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-74263087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26e58032-d0c9-47e7-b76d-7d5f21827182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a97b52014f454cf9b86435a19eb75db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:11Z,use_quota=True,user_id='a3246ec95b4e4a7886249c19592b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Creating volume 26e58032-d0c9-47e7-b76d-7d5f21827182 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:02:12 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-26e58032-d0c9-47e7-b76d-7d5f21827182 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:02:12 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-26e58032-d0c9-47e7-b76d-7d5f21827182 1073741824 Nov 05 04:02:12 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Flow 'volume_create_manager' (5008404e-ffdd-4edd-a059-a52e134035ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d2bf1a9-fa9c-450f-b25d-759c8e479c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e874d51-9644-41ed-b646-a9b0054deab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2df28b4d-d1ad-4c4a-807d-77ad00534e29', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51ecd16-05fe-4956-ae16-5431ea261a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d2bf1a9-fa9c-450f-b25d-759c8e479c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-579138123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1126ccd-7f27-4ca0-868d-3674d6a3d78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a97b52014f454cf9b86435a19eb75db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:12Z,use_quota=True,user_id='a3246ec95b4e4a7886249c19592b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f26b9b-593e-4753-a9fe-145b917e67d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f26b9b-593e-4753-a9fe-145b917e67d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:12 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76de73a-a605-4f39-a367-1ef7ae8b0119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76de73a-a605-4f39-a367-1ef7ae8b0119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1126ccd-7f27-4ca0-868d-3674d6a3d78d', 'volume_name': 'volume-c1126ccd-7f27-4ca0-868d-3674d6a3d78d', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d0556eb-cfe2-4b3b-8cd8-cbd62ef02210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d0556eb-cfe2-4b3b-8cd8-cbd62ef02210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8548bd59-f518-48a7-aacd-9cd0902d42a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:12 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Volume c1126ccd-7f27-4ca0-868d-3674d6a3d78d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1126ccd-7f27-4ca0-868d-3674d6a3d78d', 'volume_size': 1} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:12 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Volume volume-2df28b4d-d1ad-4c4a-807d-77ad00534e29 (2df28b4d-d1ad-4c4a-807d-77ad00534e29): created successfully Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51ecd16-05fe-4956-ae16-5431ea261a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Flow 'volume_create_manager' (f2010a2c-b36c-450d-b858-4c3401e97018) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-803f93cc-5cd8-464d-a9cb-757fd96d9dd6 tempest-VolumeDependencyTests-829250185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.427s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-803f93cc-5cd8-464d-a9cb-757fd96d9dd6 tempest-VolumeDependencyTests-829250185 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:12 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-803f93cc-5cd8-464d-a9cb-757fd96d9dd6 tempest-VolumeDependencyTests-829250185 None] Deleted volume successfully. Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a18ec607-c002-4020-a30a-57563ccd451c tempest-CinderUnicodeTest-1477526589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a18ec607-c002-4020-a30a-57563ccd451c tempest-CinderUnicodeTest-1477526589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a18ec607-c002-4020-a30a-57563ccd451c tempest-CinderUnicodeTest-1477526589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a18ec607-c002-4020-a30a-57563ccd451c tempest-CinderUnicodeTest-1477526589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a18ec607-c002-4020-a30a-57563ccd451c tempest-CinderUnicodeTest-1477526589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a18ec607-c002-4020-a30a-57563ccd451c tempest-CinderUnicodeTest-1477526589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:12 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-1237f6dc-6c73-4852-b0bb-dee85f683a40 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Created volume successfully. Nov 05 04:02:12 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:12 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-803f93cc-5cd8-464d-a9cb-757fd96d9dd6 tempest-VolumeDependencyTests-829250185 None] Lock "cinder-f7c05c96-db74-49f8-8c20-14aef022ace6-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Flow 'volume_create_manager' (816f258a-cb61-4d01-9b84-1d1e41f8a371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7bfba2-3e05-44a2-8306-f0cce719eaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-349e5623-2a49-486c-8219-8da785a84f1b tempest-VolumeDependencyTests-829250185 None] Acquiring lock "cinder-4377d754-c768-45b2-b6e1-e8d2160c2f86-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-349e5623-2a49-486c-8219-8da785a84f1b tempest-VolumeDependencyTests-829250185 None] Lock "cinder-4377d754-c768-45b2-b6e1-e8d2160c2f86-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f7bfba2-3e05-44a2-8306-f0cce719eaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1165033266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb811d4b-61f6-4071-bc0a-d653de81d66a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a97b52014f454cf9b86435a19eb75db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:12Z,use_quota=True,user_id='a3246ec95b4e4a7886249c19592b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17adbd55-1f1d-4874-ac22-69cc1390b61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17adbd55-1f1d-4874-ac22-69cc1390b61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1c646d-c455-4316-b19f-a4ee0f3c46f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1c646d-c455-4316-b19f-a4ee0f3c46f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb811d4b-61f6-4071-bc0a-d653de81d66a', 'volume_name': 'volume-eb811d4b-61f6-4071-bc0a-d653de81d66a', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8042791a-3730-4db1-8c4c-81b498f8cc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8042791a-3730-4db1-8c4c-81b498f8cc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6661c6f9-add4-4d19-999b-32582bcd590e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:12 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Volume eb811d4b-61f6-4071-bc0a-d653de81d66a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb811d4b-61f6-4071-bc0a-d653de81d66a', 'volume_size': 1} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:12 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a18ec607-c002-4020-a30a-57563ccd451c tempest-CinderUnicodeTest-1477526589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.360s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-a18ec607-c002-4020-a30a-57563ccd451c tempest-CinderUnicodeTest-1477526589 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:12 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:12 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-a18ec607-c002-4020-a30a-57563ccd451c tempest-CinderUnicodeTest-1477526589 None] Deleted volume successfully. Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-26e58032-d0c9-47e7-b76d-7d5f21827182 1073741824" returned: 0 in 0.663s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-349e5623-2a49-486c-8219-8da785a84f1b tempest-VolumeDependencyTests-829250185 None] Acquiring lock "cinder-quobyte-4377d754-c768-45b2-b6e1-e8d2160c2f86" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a18ec607-c002-4020-a30a-57563ccd451c tempest-CinderUnicodeTest-1477526589 None] Lock "cinder-6ea388ef-f298-43e7-9186-7768811048a1-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-349e5623-2a49-486c-8219-8da785a84f1b tempest-VolumeDependencyTests-829250185 None] Lock "cinder-quobyte-4377d754-c768-45b2-b6e1-e8d2160c2f86" acquired by "delete_volume" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-26e58032-d0c9-47e7-b76d-7d5f21827182 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[80905f0e-8d78-4a79-9592-b71d4a08dbf2]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-349e5623-2a49-486c-8219-8da785a84f1b tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4377d754-c768-45b2-b6e1-e8d2160c2f86 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:13 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-26e58032-d0c9-47e7-b76d-7d5f21827182 Nov 05 04:02:13 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6a46d5b3-1dbf-4780-8be0-6440ed65759e tempest-CinderUnicodeTest-1477526589 None] Acquiring lock "cinder-c57869eb-0010-41a1-8f63-f2e5cec29ad4-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6a46d5b3-1dbf-4780-8be0-6440ed65759e tempest-CinderUnicodeTest-1477526589 None] Lock "cinder-c57869eb-0010-41a1-8f63-f2e5cec29ad4-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:02:13 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4377d754-c768-45b2-b6e1-e8d2160c2f86 Nov 05 04:02:13 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Flow 'volume_create_manager' (1577c600-9989-4117-a48b-1a3397d394fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ff4ad73-d9ea-4f97-a832-aa97db432c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ff4ad73-d9ea-4f97-a832-aa97db432c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1878563460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7206c22d-8a03-4551-8c39-e7aa797f36ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a97b52014f454cf9b86435a19eb75db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:13Z,use_quota=True,user_id='a3246ec95b4e4a7886249c19592b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad427e35-7f7a-4fcb-bce9-e7a50baab1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad427e35-7f7a-4fcb-bce9-e7a50baab1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8032b142-ac61-4391-9aeb-0f471e80fa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8032b142-ac61-4391-9aeb-0f471e80fa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7206c22d-8a03-4551-8c39-e7aa797f36ee', 'volume_name': 'volume-7206c22d-8a03-4551-8c39-e7aa797f36ee', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf7fc09f-a75e-42c4-8887-4d9c12a0ae55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf7fc09f-a75e-42c4-8887-4d9c12a0ae55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211de7df-a191-491a-8836-80f20bf45c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:13 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Volume 7206c22d-8a03-4551-8c39-e7aa797f36ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7206c22d-8a03-4551-8c39-e7aa797f36ee', 'volume_size': 1} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6a46d5b3-1dbf-4780-8be0-6440ed65759e tempest-CinderUnicodeTest-1477526589 None] Acquiring lock "cinder-quobyte-c57869eb-0010-41a1-8f63-f2e5cec29ad4" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6a46d5b3-1dbf-4780-8be0-6440ed65759e tempest-CinderUnicodeTest-1477526589 None] Lock "cinder-quobyte-c57869eb-0010-41a1-8f63-f2e5cec29ad4" acquired by "delete_volume" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:13 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-26e58032-d0c9-47e7-b76d-7d5f21827182" returned: 0 in 0.362s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bebf20df-57c8-4350-afcf-d2154e78896c tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.141s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[708c5851-14ac-4c58-8e4a-3ab944c64681]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6a46d5b3-1dbf-4780-8be0-6440ed65759e tempest-CinderUnicodeTest-1477526589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c57869eb-0010-41a1-8f63-f2e5cec29ad4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7de84d5-fe16-46e0-b7ff-c8e8531ca471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26e58032-d0c9-47e7-b76d-7d5f21827182', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8443001-bf4c-4757-b834-d806f4e8b8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-bebf20df-57c8-4350-afcf-d2154e78896c tempest-CreateVolumesFromSnapshotTest-2097811942 None] Creating offline snapshot feb18ee5-bcad-4fb7-888c-0d8df9967329 of volume e0f4153b-ebbc-487a-8013-3e6cb534148e {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:02:13 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Volume volume-26e58032-d0c9-47e7-b76d-7d5f21827182 (26e58032-d0c9-47e7-b76d-7d5f21827182): created successfully Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8443001-bf4c-4757-b834-d806f4e8b8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Flow 'volume_create_manager' (050da5a0-bfa3-4689-ae9b-e3dd94fc9d1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[555d834f-b5ff-43e6-9cc6-1198f64505c0]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bebf20df-57c8-4350-afcf-d2154e78896c tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:13 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b0d22c32-3213-43f1-8fad-b6ad5a685b45 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Created volume successfully. Nov 05 04:02:13 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c57869eb-0010-41a1-8f63-f2e5cec29ad4 Nov 05 04:02:13 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:13 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-349e5623-2a49-486c-8219-8da785a84f1b tempest-VolumeDependencyTests-829250185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4377d754-c768-45b2-b6e1-e8d2160c2f86" returned: 0 in 0.515s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-349e5623-2a49-486c-8219-8da785a84f1b tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4377d754-c768-45b2-b6e1-e8d2160c2f86 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:13 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4377d754-c768-45b2-b6e1-e8d2160c2f86 Nov 05 04:02:13 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:13 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e Nov 05 04:02:13 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:13 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6a46d5b3-1dbf-4780-8be0-6440ed65759e tempest-CinderUnicodeTest-1477526589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c57869eb-0010-41a1-8f63-f2e5cec29ad4" returned: 0 in 0.416s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6a46d5b3-1dbf-4780-8be0-6440ed65759e tempest-CinderUnicodeTest-1477526589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c57869eb-0010-41a1-8f63-f2e5cec29ad4 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:13 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-349e5623-2a49-486c-8219-8da785a84f1b tempest-VolumeDependencyTests-829250185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4377d754-c768-45b2-b6e1-e8d2160c2f86" returned: 0 in 0.279s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:13 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c57869eb-0010-41a1-8f63-f2e5cec29ad4 Nov 05 04:02:13 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-349e5623-2a49-486c-8219-8da785a84f1b tempest-VolumeDependencyTests-829250185 None] Lock "cinder-quobyte-4377d754-c768-45b2-b6e1-e8d2160c2f86" released by "delete_volume" :: held 0.890s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:13 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bebf20df-57c8-4350-afcf-d2154e78896c tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e" returned: 0 in 0.423s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bebf20df-57c8-4350-afcf-d2154e78896c tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.feb18ee5-bcad-4fb7-888c-0d8df9967329 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:13 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.feb18ee5-bcad-4fb7-888c-0d8df9967329 1G Nov 05 04:02:13 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-349e5623-2a49-486c-8219-8da785a84f1b tempest-VolumeDependencyTests-829250185 None] Created reservations ['25ddd4f9-9bd3-4079-94a6-bda25d48c0ac', 'd3884832-ddd0-4c1e-9e67-d12618ccb829', '27cdda99-cfb6-473b-b8af-a5a4affdbb15', '6f293b77-59cb-4e82-a7cc-e9b9ea061ef6'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-349e5623-2a49-486c-8219-8da785a84f1b tempest-VolumeDependencyTests-829250185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-349e5623-2a49-486c-8219-8da785a84f1b tempest-VolumeDependencyTests-829250185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-349e5623-2a49-486c-8219-8da785a84f1b tempest-VolumeDependencyTests-829250185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-349e5623-2a49-486c-8219-8da785a84f1b tempest-VolumeDependencyTests-829250185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-349e5623-2a49-486c-8219-8da785a84f1b tempest-VolumeDependencyTests-829250185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-349e5623-2a49-486c-8219-8da785a84f1b tempest-VolumeDependencyTests-829250185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:13 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:13 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:14 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6a46d5b3-1dbf-4780-8be0-6440ed65759e tempest-CinderUnicodeTest-1477526589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c57869eb-0010-41a1-8f63-f2e5cec29ad4" returned: 0 in 0.270s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6a46d5b3-1dbf-4780-8be0-6440ed65759e tempest-CinderUnicodeTest-1477526589 None] Lock "cinder-quobyte-c57869eb-0010-41a1-8f63-f2e5cec29ad4" released by "delete_volume" :: held 0.733s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:14 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-6a46d5b3-1dbf-4780-8be0-6440ed65759e tempest-CinderUnicodeTest-1477526589 None] Created reservations ['657952be-1632-47e7-a0ed-d7aff3a8e256', 'fdebe825-259a-4415-a302-014b3a02ed21', 'f2cf3b08-a9f8-4358-90f5-396958f0bb40', '1e7c396e-7faa-4af5-b031-bb0866e340a6'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6a46d5b3-1dbf-4780-8be0-6440ed65759e tempest-CinderUnicodeTest-1477526589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6a46d5b3-1dbf-4780-8be0-6440ed65759e tempest-CinderUnicodeTest-1477526589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6a46d5b3-1dbf-4780-8be0-6440ed65759e tempest-CinderUnicodeTest-1477526589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6a46d5b3-1dbf-4780-8be0-6440ed65759e tempest-CinderUnicodeTest-1477526589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6a46d5b3-1dbf-4780-8be0-6440ed65759e tempest-CinderUnicodeTest-1477526589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6a46d5b3-1dbf-4780-8be0-6440ed65759e tempest-CinderUnicodeTest-1477526589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:14 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:14 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:14 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-349e5623-2a49-486c-8219-8da785a84f1b tempest-VolumeDependencyTests-829250185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.307s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:14 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-349e5623-2a49-486c-8219-8da785a84f1b tempest-VolumeDependencyTests-829250185 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:14 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-349e5623-2a49-486c-8219-8da785a84f1b tempest-VolumeDependencyTests-829250185 None] Deleted volume successfully. Nov 05 04:02:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-349e5623-2a49-486c-8219-8da785a84f1b tempest-VolumeDependencyTests-829250185 None] Lock "cinder-4377d754-c768-45b2-b6e1-e8d2160c2f86-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:14 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bebf20df-57c8-4350-afcf-d2154e78896c tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.feb18ee5-bcad-4fb7-888c-0d8df9967329 1G" returned: 0 in 0.551s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bebf20df-57c8-4350-afcf-d2154e78896c tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0f4153b-ebbc-487a-8013-3e6cb534148e -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.feb18ee5-bcad-4fb7-888c-0d8df9967329 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:14 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0f4153b-ebbc-487a-8013-3e6cb534148e -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.feb18ee5-bcad-4fb7-888c-0d8df9967329 Nov 05 04:02:14 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:14 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6a46d5b3-1dbf-4780-8be0-6440ed65759e tempest-CinderUnicodeTest-1477526589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.308s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:14 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-6a46d5b3-1dbf-4780-8be0-6440ed65759e tempest-CinderUnicodeTest-1477526589 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:14 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-6a46d5b3-1dbf-4780-8be0-6440ed65759e tempest-CinderUnicodeTest-1477526589 None] Deleted volume successfully. Nov 05 04:02:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6a46d5b3-1dbf-4780-8be0-6440ed65759e tempest-CinderUnicodeTest-1477526589 None] Lock "cinder-c57869eb-0010-41a1-8f63-f2e5cec29ad4-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:14 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bebf20df-57c8-4350-afcf-d2154e78896c tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0f4153b-ebbc-487a-8013-3e6cb534148e -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.feb18ee5-bcad-4fb7-888c-0d8df9967329" returned: 0 in 0.336s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:14 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-bebf20df-57c8-4350-afcf-d2154e78896c tempest-CreateVolumesFromSnapshotTest-2097811942 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.feb18ee5-bcad-4fb7-888c-0d8df9967329 is being set with open permissions: ugo+rw Nov 05 04:02:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bebf20df-57c8-4350-afcf-d2154e78896c tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.feb18ee5-bcad-4fb7-888c-0d8df9967329 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:14 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.feb18ee5-bcad-4fb7-888c-0d8df9967329 Nov 05 04:02:14 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:14 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bebf20df-57c8-4350-afcf-d2154e78896c tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.feb18ee5-bcad-4fb7-888c-0d8df9967329" returned: 0 in 0.261s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bebf20df-57c8-4350-afcf-d2154e78896c tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:15 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.info Nov 05 04:02:15 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:15 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bebf20df-57c8-4350-afcf-d2154e78896c tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.info" returned: 0 in 0.356s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:15 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-bebf20df-57c8-4350-afcf-d2154e78896c tempest-CreateVolumesFromSnapshotTest-2097811942 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.info is being set with open permissions: ugo+rw Nov 05 04:02:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bebf20df-57c8-4350-afcf-d2154e78896c tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:15 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.info Nov 05 04:02:15 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:15 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bebf20df-57c8-4350-afcf-d2154e78896c tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.info" returned: 0 in 0.281s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bebf20df-57c8-4350-afcf-d2154e78896c tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.380s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.288s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-579138123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1126ccd-7f27-4ca0-868d-3674d6a3d78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a97b52014f454cf9b86435a19eb75db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:12Z,use_quota=True,user_id='a3246ec95b4e4a7886249c19592b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:02:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Creating volume c1126ccd-7f27-4ca0-868d-3674d6a3d78d {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:02:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:02:15 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:02:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1126ccd-7f27-4ca0-868d-3674d6a3d78d 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:15 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1126ccd-7f27-4ca0-868d-3674d6a3d78d 1073741824 Nov 05 04:02:15 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:15 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-bebf20df-57c8-4350-afcf-d2154e78896c tempest-CreateVolumesFromSnapshotTest-2097811942 None] Create snapshot completed successfully Nov 05 04:02:16 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1126ccd-7f27-4ca0-868d-3674d6a3d78d 1073741824" returned: 0 in 0.794s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1126ccd-7f27-4ca0-868d-3674d6a3d78d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:16 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1126ccd-7f27-4ca0-868d-3674d6a3d78d Nov 05 04:02:16 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:16 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1126ccd-7f27-4ca0-868d-3674d6a3d78d" returned: 0 in 0.352s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:02:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.134s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1165033266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb811d4b-61f6-4071-bc0a-d653de81d66a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a97b52014f454cf9b86435a19eb75db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:12Z,use_quota=True,user_id='a3246ec95b4e4a7886249c19592b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:02:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Creating volume eb811d4b-61f6-4071-bc0a-d653de81d66a {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:02:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:16 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:02:16 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:02:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eb811d4b-61f6-4071-bc0a-d653de81d66a 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8548bd59-f518-48a7-aacd-9cd0902d42a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1126ccd-7f27-4ca0-868d-3674d6a3d78d', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b138eb-bfee-477e-96ca-3330067fa71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:17 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eb811d4b-61f6-4071-bc0a-d653de81d66a 1073741824 Nov 05 04:02:17 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Flow 'volume_create_manager' (c029a0c0-18b9-4ffa-a80e-45ee885f5a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094610ae-fdd3-407f-a75e-fa98dbc62843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:17 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Volume volume-c1126ccd-7f27-4ca0-868d-3674d6a3d78d (c1126ccd-7f27-4ca0-868d-3674d6a3d78d): created successfully Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b138eb-bfee-477e-96ca-3330067fa71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Flow 'volume_create_manager' (5008404e-ffdd-4edd-a059-a52e134035ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (094610ae-fdd3-407f-a75e-fa98dbc62843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1208905280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcba5403-2f75-43b0-b60b-3ac08a104cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93c69acbac24c06a8467c24d2935536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:17Z,use_quota=True,user_id='0927b2fd243a4a3592e1eb4df07e5ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc062307-e25a-43b4-8fa6-c0253a3ec8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc062307-e25a-43b4-8fa6-c0253a3ec8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d13ac60-72a2-43c8-8ae5-adc517b6b95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d13ac60-72a2-43c8-8ae5-adc517b6b95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcba5403-2f75-43b0-b60b-3ac08a104cd6', 'volume_name': 'volume-fcba5403-2f75-43b0-b60b-3ac08a104cd6', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc51b488-831f-4b71-832d-ec6b6310f533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc51b488-831f-4b71-832d-ec6b6310f533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557a4345-f37b-4a30-abba-bc4800a08f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:17 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Volume fcba5403-2f75-43b0-b60b-3ac08a104cd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcba5403-2f75-43b0-b60b-3ac08a104cd6', 'volume_size': 1} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:17 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-4719dc79-ddea-400c-9eee-1c237871adf9 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Created volume successfully. Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Flow 'volume_create_manager' (de9b822a-b1c8-4240-894e-6cb65336a243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10ce9d36-177a-49d9-a59f-7803c5f99d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10ce9d36-177a-49d9-a59f-7803c5f99d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1824194978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709fe45f-3b38-4c12-bb01-c45ab7e32f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93c69acbac24c06a8467c24d2935536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:17Z,use_quota=True,user_id='0927b2fd243a4a3592e1eb4df07e5ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31113f59-bb85-4abe-a0e8-1c1d9978e39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31113f59-bb85-4abe-a0e8-1c1d9978e39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c986022-8d48-4337-9332-8a0eb54f937f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c986022-8d48-4337-9332-8a0eb54f937f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '709fe45f-3b38-4c12-bb01-c45ab7e32f3a', 'volume_name': 'volume-709fe45f-3b38-4c12-bb01-c45ab7e32f3a', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97bdde95-0c38-407c-ae7a-652828c8d191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97bdde95-0c38-407c-ae7a-652828c8d191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7fe5f9-d877-4841-9a97-684fa89a9c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:17 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Volume 709fe45f-3b38-4c12-bb01-c45ab7e32f3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-709fe45f-3b38-4c12-bb01-c45ab7e32f3a', 'volume_size': 1} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:17 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eb811d4b-61f6-4071-bc0a-d653de81d66a 1073741824" returned: 0 in 0.832s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eb811d4b-61f6-4071-bc0a-d653de81d66a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:17 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eb811d4b-61f6-4071-bc0a-d653de81d66a Nov 05 04:02:17 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Flow 'volume_create_manager' (39d4eeb8-ffa0-4829-aa20-6a356df0a95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:17 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec74698-9d4b-444b-9fca-ba83c5f0d47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec74698-9d4b-444b-9fca-ba83c5f0d47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1813710646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf763fe-cf55-44f3-bfcd-4875fb10ba22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93c69acbac24c06a8467c24d2935536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:18Z,use_quota=True,user_id='0927b2fd243a4a3592e1eb4df07e5ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4489cf5-d1a9-4d8d-8a0f-baf6a026acb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4489cf5-d1a9-4d8d-8a0f-baf6a026acb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d851cba5-f328-4fad-8516-db3787b8a991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d851cba5-f328-4fad-8516-db3787b8a991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbf763fe-cf55-44f3-bfcd-4875fb10ba22', 'volume_name': 'volume-cbf763fe-cf55-44f3-bfcd-4875fb10ba22', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579ae7b3-f09b-450d-9eb6-1a9320eca47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579ae7b3-f09b-450d-9eb6-1a9320eca47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e86119-294e-4964-8da3-9af7d1cfb2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:18 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Volume cbf763fe-cf55-44f3-bfcd-4875fb10ba22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbf763fe-cf55-44f3-bfcd-4875fb10ba22', 'volume_size': 1} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:18 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eb811d4b-61f6-4071-bc0a-d653de81d66a" returned: 0 in 0.363s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.922s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1878563460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7206c22d-8a03-4551-8c39-e7aa797f36ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a97b52014f454cf9b86435a19eb75db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:13Z,use_quota=True,user_id='a3246ec95b4e4a7886249c19592b44d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Creating volume 7206c22d-8a03-4551-8c39-e7aa797f36ee {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:02:18 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7206c22d-8a03-4551-8c39-e7aa797f36ee 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:18 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7206c22d-8a03-4551-8c39-e7aa797f36ee 1073741824 Nov 05 04:02:18 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6661c6f9-add4-4d19-999b-32582bcd590e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb811d4b-61f6-4071-bc0a-d653de81d66a', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae589bf-9fbd-43a7-8886-3bd2212c8963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:18 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Volume volume-eb811d4b-61f6-4071-bc0a-d653de81d66a (eb811d4b-61f6-4071-bc0a-d653de81d66a): created successfully Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae589bf-9fbd-43a7-8886-3bd2212c8963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Flow 'volume_create_manager' (816f258a-cb61-4d01-9b84-1d1e41f8a371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:18 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-11254902-b751-4d93-9e03-0b263b716084 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Created volume successfully. Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Flow 'volume_create_manager' (1d4ebb2f-dd0d-4953-b5d4-1458ed0e03d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c84370-9ceb-4aa1-99af-d3e6cb9af607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c84370-9ceb-4aa1-99af-d3e6cb9af607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1557543935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b8297f-9b7b-4101-ad1b-79108bb0e8fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93c69acbac24c06a8467c24d2935536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:18Z,use_quota=True,user_id='0927b2fd243a4a3592e1eb4df07e5ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c59bb8b0-7ff6-4724-82c0-e629692f563d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c59bb8b0-7ff6-4724-82c0-e629692f563d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429f7afa-968a-4ec9-ac3a-61152b216e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429f7afa-968a-4ec9-ac3a-61152b216e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4b8297f-9b7b-4101-ad1b-79108bb0e8fb', 'volume_name': 'volume-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b172229a-571c-461b-802c-2702d721babf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b172229a-571c-461b-802c-2702d721babf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4235c97-183c-449b-8754-c758c3ca878c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:18 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Volume e4b8297f-9b7b-4101-ad1b-79108bb0e8fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb', 'volume_size': 1} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:18 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7206c22d-8a03-4551-8c39-e7aa797f36ee 1073741824" returned: 0 in 0.627s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7206c22d-8a03-4551-8c39-e7aa797f36ee {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:18 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7206c22d-8a03-4551-8c39-e7aa797f36ee Nov 05 04:02:18 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:18 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Flow 'volume_create_manager' (291ac1f1-a775-481c-b2c5-e03d257e9b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd22d27-a88c-4941-a66f-6b423059e8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fd22d27-a88c-4941-a66f-6b423059e8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-303013714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b00d391-fa10-4de3-bfdd-9050623f797d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93c69acbac24c06a8467c24d2935536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:19Z,use_quota=True,user_id='0927b2fd243a4a3592e1eb4df07e5ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2512b517-08ba-4423-a6d0-7f34f072dcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2512b517-08ba-4423-a6d0-7f34f072dcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4b31bb-c242-49fb-bc2d-cd20c17fbd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4b31bb-c242-49fb-bc2d-cd20c17fbd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b00d391-fa10-4de3-bfdd-9050623f797d', 'volume_name': 'volume-6b00d391-fa10-4de3-bfdd-9050623f797d', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12cd821f-4ae5-44b7-bf31-cfa9a2460933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12cd821f-4ae5-44b7-bf31-cfa9a2460933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7005f1-56a3-41b1-9fb9-d4d39d698537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:19 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Volume 6b00d391-fa10-4de3-bfdd-9050623f797d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b00d391-fa10-4de3-bfdd-9050623f797d', 'volume_size': 1} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:19 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7206c22d-8a03-4551-8c39-e7aa797f36ee" returned: 0 in 0.298s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.963s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1208905280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcba5403-2f75-43b0-b60b-3ac08a104cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93c69acbac24c06a8467c24d2935536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:17Z,use_quota=True,user_id='0927b2fd243a4a3592e1eb4df07e5ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Creating volume fcba5403-2f75-43b0-b60b-3ac08a104cd6 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:02:19 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fcba5403-2f75-43b0-b60b-3ac08a104cd6 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211de7df-a191-491a-8836-80f20bf45c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7206c22d-8a03-4551-8c39-e7aa797f36ee', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:19 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fcba5403-2f75-43b0-b60b-3ac08a104cd6 1073741824 Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76aa2684-b347-4d13-813e-d891ba8f894e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:19 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:19 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Volume volume-7206c22d-8a03-4551-8c39-e7aa797f36ee (7206c22d-8a03-4551-8c39-e7aa797f36ee): created successfully Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76aa2684-b347-4d13-813e-d891ba8f894e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Flow 'volume_create_manager' (1577c600-9989-4117-a48b-1a3397d394fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:19 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-8ddd8b4e-7abe-4d89-b964-4c960c5a9949 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Created volume successfully. Nov 05 04:02:19 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fcba5403-2f75-43b0-b60b-3ac08a104cd6 1073741824" returned: 0 in 0.544s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Flow 'volume_create_manager' (9bbc1043-af22-4f4e-9fa9-1be201295b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c3e78b8-09f6-49de-b32c-9998a0c6aa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fcba5403-2f75-43b0-b60b-3ac08a104cd6 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c3e78b8-09f6-49de-b32c-9998a0c6aa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1032316268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27761b2-1e5d-417e-8388-6ef59ab61342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f61cc92dd46408041e858fdab3dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:20Z,use_quota=True,user_id='840642882ebf4ec4ac16689c21ed946f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845aaeea-50f2-44d9-9055-283b0aa813cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:19 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fcba5403-2f75-43b0-b60b-3ac08a104cd6 Nov 05 04:02:19 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (845aaeea-50f2-44d9-9055-283b0aa813cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a82dd1c-c35c-4d17-b928-754b9d20fd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a82dd1c-c35c-4d17-b928-754b9d20fd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a27761b2-1e5d-417e-8388-6ef59ab61342', 'volume_name': 'volume-a27761b2-1e5d-417e-8388-6ef59ab61342', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01b46b4-a97f-468c-a439-b3e2c83c25f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b01b46b4-a97f-468c-a439-b3e2c83c25f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f5c1da-a635-4f1c-8a12-46fac6fc4d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:19 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Volume a27761b2-1e5d-417e-8388-6ef59ab61342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a27761b2-1e5d-417e-8388-6ef59ab61342', 'volume_size': 1} Nov 05 04:02:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-289053dd-ae56-481c-a4c9-b21b91f050ea tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "cinder-7206c22d-8a03-4551-8c39-e7aa797f36ee-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-289053dd-ae56-481c-a4c9-b21b91f050ea tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-7206c22d-8a03-4551-8c39-e7aa797f36ee-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-289053dd-ae56-481c-a4c9-b21b91f050ea tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "cinder-quobyte-7206c22d-8a03-4551-8c39-e7aa797f36ee" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-289053dd-ae56-481c-a4c9-b21b91f050ea tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-quobyte-7206c22d-8a03-4551-8c39-e7aa797f36ee" acquired by "delete_volume" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[844d112f-aa95-44da-a212-b14c94abdc7c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-289053dd-ae56-481c-a4c9-b21b91f050ea tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7206c22d-8a03-4551-8c39-e7aa797f36ee {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:20 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fcba5403-2f75-43b0-b60b-3ac08a104cd6" returned: 0 in 0.361s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.700s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1824194978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709fe45f-3b38-4c12-bb01-c45ab7e32f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93c69acbac24c06a8467c24d2935536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:17Z,use_quota=True,user_id='0927b2fd243a4a3592e1eb4df07e5ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Creating volume 709fe45f-3b38-4c12-bb01-c45ab7e32f3a {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:02:20 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-709fe45f-3b38-4c12-bb01-c45ab7e32f3a 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557a4345-f37b-4a30-abba-bc4800a08f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcba5403-2f75-43b0-b60b-3ac08a104cd6', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c331757-b8f8-443b-805a-a6ee3bfdf58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:20 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-709fe45f-3b38-4c12-bb01-c45ab7e32f3a 1073741824 Nov 05 04:02:20 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:20 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Volume volume-fcba5403-2f75-43b0-b60b-3ac08a104cd6 (fcba5403-2f75-43b0-b60b-3ac08a104cd6): created successfully Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c331757-b8f8-443b-805a-a6ee3bfdf58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Flow 'volume_create_manager' (c029a0c0-18b9-4ffa-a80e-45ee885f5a8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:20 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5f2ae9a0-383a-466d-817b-4fd5f506e006 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Created volume successfully. Nov 05 04:02:20 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7206c22d-8a03-4551-8c39-e7aa797f36ee Nov 05 04:02:20 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:20 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-289053dd-ae56-481c-a4c9-b21b91f050ea tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7206c22d-8a03-4551-8c39-e7aa797f36ee" returned: 0 in 0.415s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-289053dd-ae56-481c-a4c9-b21b91f050ea tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7206c22d-8a03-4551-8c39-e7aa797f36ee {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:20 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7206c22d-8a03-4551-8c39-e7aa797f36ee Nov 05 04:02:20 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:20 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-709fe45f-3b38-4c12-bb01-c45ab7e32f3a 1073741824" returned: 0 in 0.527s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-709fe45f-3b38-4c12-bb01-c45ab7e32f3a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:20 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-709fe45f-3b38-4c12-bb01-c45ab7e32f3a Nov 05 04:02:20 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:20 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-289053dd-ae56-481c-a4c9-b21b91f050ea tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7206c22d-8a03-4551-8c39-e7aa797f36ee" returned: 0 in 0.280s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-289053dd-ae56-481c-a4c9-b21b91f050ea tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-quobyte-7206c22d-8a03-4551-8c39-e7aa797f36ee" released by "delete_volume" :: held 0.753s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:20 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-289053dd-ae56-481c-a4c9-b21b91f050ea tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Created reservations ['9db9ce86-45d4-43a3-96b9-3b0286e5dd1e', 'cc1b1041-e616-4e96-885e-32692a65481a', 'b5494a80-7ed4-475c-9fbd-5bae02a7881b', '24e1b2f2-5126-4c48-a98b-6f0dc879a920'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-289053dd-ae56-481c-a4c9-b21b91f050ea tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-289053dd-ae56-481c-a4c9-b21b91f050ea tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-289053dd-ae56-481c-a4c9-b21b91f050ea tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-289053dd-ae56-481c-a4c9-b21b91f050ea tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-289053dd-ae56-481c-a4c9-b21b91f050ea tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-289053dd-ae56-481c-a4c9-b21b91f050ea tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:21 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-709fe45f-3b38-4c12-bb01-c45ab7e32f3a" returned: 0 in 0.304s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.067s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:21 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1813710646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf763fe-cf55-44f3-bfcd-4875fb10ba22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93c69acbac24c06a8467c24d2935536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:18Z,use_quota=True,user_id='0927b2fd243a4a3592e1eb4df07e5ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Creating volume cbf763fe-cf55-44f3-bfcd-4875fb10ba22 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:21 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:02:21 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-cbf763fe-cf55-44f3-bfcd-4875fb10ba22 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7fe5f9-d877-4841-9a97-684fa89a9c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-709fe45f-3b38-4c12-bb01-c45ab7e32f3a', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:21 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-cbf763fe-cf55-44f3-bfcd-4875fb10ba22 1073741824 Nov 05 04:02:21 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e920c0a0-12f1-49c6-b0af-e391cb830295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:21 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Volume volume-709fe45f-3b38-4c12-bb01-c45ab7e32f3a (709fe45f-3b38-4c12-bb01-c45ab7e32f3a): created successfully Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e920c0a0-12f1-49c6-b0af-e391cb830295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Flow 'volume_create_manager' (de9b822a-b1c8-4240-894e-6cb65336a243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:21 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-0abbb071-2dbd-454c-845f-d4b7e3923ceb tempest-CreateVolumesFromSnapshotTest-2097811942 None] Created volume successfully. Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5704b27e-6f4a-4a22-a2bc-3ddea8cd92fa tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "cinder-eb811d4b-61f6-4071-bc0a-d653de81d66a-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5704b27e-6f4a-4a22-a2bc-3ddea8cd92fa tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-eb811d4b-61f6-4071-bc0a-d653de81d66a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:21 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-289053dd-ae56-481c-a4c9-b21b91f050ea tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.299s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-289053dd-ae56-481c-a4c9-b21b91f050ea tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:21 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-289053dd-ae56-481c-a4c9-b21b91f050ea tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Deleted volume successfully. Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5704b27e-6f4a-4a22-a2bc-3ddea8cd92fa tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "cinder-quobyte-eb811d4b-61f6-4071-bc0a-d653de81d66a" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5704b27e-6f4a-4a22-a2bc-3ddea8cd92fa tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-quobyte-eb811d4b-61f6-4071-bc0a-d653de81d66a" acquired by "delete_volume" :: waited 0.022s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-289053dd-ae56-481c-a4c9-b21b91f050ea tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-7206c22d-8a03-4551-8c39-e7aa797f36ee-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0e78c3-9447-44d1-94d0-0c91030c96bd]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5704b27e-6f4a-4a22-a2bc-3ddea8cd92fa tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eb811d4b-61f6-4071-bc0a-d653de81d66a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:21 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eb811d4b-61f6-4071-bc0a-d653de81d66a Nov 05 04:02:21 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:21 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-cbf763fe-cf55-44f3-bfcd-4875fb10ba22 1073741824" returned: 0 in 0.619s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-cbf763fe-cf55-44f3-bfcd-4875fb10ba22 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:21 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-cbf763fe-cf55-44f3-bfcd-4875fb10ba22 Nov 05 04:02:21 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:21 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5704b27e-6f4a-4a22-a2bc-3ddea8cd92fa tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eb811d4b-61f6-4071-bc0a-d653de81d66a" returned: 0 in 0.432s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5704b27e-6f4a-4a22-a2bc-3ddea8cd92fa tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eb811d4b-61f6-4071-bc0a-d653de81d66a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:21 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eb811d4b-61f6-4071-bc0a-d653de81d66a Nov 05 04:02:21 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:22 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-cbf763fe-cf55-44f3-bfcd-4875fb10ba22" returned: 0 in 0.283s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.466s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1557543935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b8297f-9b7b-4101-ad1b-79108bb0e8fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93c69acbac24c06a8467c24d2935536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:18Z,use_quota=True,user_id='0927b2fd243a4a3592e1eb4df07e5ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Creating volume e4b8297f-9b7b-4101-ad1b-79108bb0e8fb {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:02:22 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e86119-294e-4964-8da3-9af7d1cfb2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbf763fe-cf55-44f3-bfcd-4875fb10ba22', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:22 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb 1073741824 Nov 05 04:02:22 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f2944e-cdf7-4b6d-a74d-035016f33b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:22 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Volume volume-cbf763fe-cf55-44f3-bfcd-4875fb10ba22 (cbf763fe-cf55-44f3-bfcd-4875fb10ba22): created successfully Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f2944e-cdf7-4b6d-a74d-035016f33b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Flow 'volume_create_manager' (39d4eeb8-ffa0-4829-aa20-6a356df0a95b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:22 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-6e226b75-849f-44d2-badc-cce8a85e06df tempest-CreateVolumesFromSnapshotTest-2097811942 None] Created volume successfully. Nov 05 04:02:22 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5704b27e-6f4a-4a22-a2bc-3ddea8cd92fa tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-eb811d4b-61f6-4071-bc0a-d653de81d66a" returned: 0 in 0.316s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5704b27e-6f4a-4a22-a2bc-3ddea8cd92fa tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-quobyte-eb811d4b-61f6-4071-bc0a-d653de81d66a" released by "delete_volume" :: held 0.807s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-5704b27e-6f4a-4a22-a2bc-3ddea8cd92fa tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Created reservations ['acc14a41-bda1-4fc5-9f96-b0d1393a3c23', '9f911526-b227-4b84-a164-b221e6de940f', '4d4684b6-5064-4fbc-b63f-abcf1e3aba6c', 'ee0c4c9e-8038-49f9-a52f-7aacfb72c049'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5704b27e-6f4a-4a22-a2bc-3ddea8cd92fa tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5704b27e-6f4a-4a22-a2bc-3ddea8cd92fa tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5704b27e-6f4a-4a22-a2bc-3ddea8cd92fa tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5704b27e-6f4a-4a22-a2bc-3ddea8cd92fa tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5704b27e-6f4a-4a22-a2bc-3ddea8cd92fa tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5704b27e-6f4a-4a22-a2bc-3ddea8cd92fa tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:22 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:22 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-79c492a8-ea2e-4d9f-ad7b-b925598a6cd7 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "cinder-c1126ccd-7f27-4ca0-868d-3674d6a3d78d-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-79c492a8-ea2e-4d9f-ad7b-b925598a6cd7 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-c1126ccd-7f27-4ca0-868d-3674d6a3d78d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-79c492a8-ea2e-4d9f-ad7b-b925598a6cd7 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "cinder-quobyte-c1126ccd-7f27-4ca0-868d-3674d6a3d78d" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-79c492a8-ea2e-4d9f-ad7b-b925598a6cd7 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-quobyte-c1126ccd-7f27-4ca0-868d-3674d6a3d78d" acquired by "delete_volume" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:22 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddf9786-d38b-464e-9869-733f18298675]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-79c492a8-ea2e-4d9f-ad7b-b925598a6cd7 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1126ccd-7f27-4ca0-868d-3674d6a3d78d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb 1073741824" returned: 0 in 0.647s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:22 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5704b27e-6f4a-4a22-a2bc-3ddea8cd92fa tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.359s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-5704b27e-6f4a-4a22-a2bc-3ddea8cd92fa tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:22 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5704b27e-6f4a-4a22-a2bc-3ddea8cd92fa tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Deleted volume successfully. Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Flow 'volume_create_manager' (04cf8310-622f-411d-b190-117709ce705f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef3b437-b093-47ed-9d8a-23c8a011af7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef3b437-b093-47ed-9d8a-23c8a011af7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=077c960e-a1c7-4505-b34c-5e9e7350d62c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='233f0cd6006f4650801b60c7b3791472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:23Z,use_quota=True,user_id='bdb0793bebc34e9d936dc8e82bdef32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32600f65-4eaf-4b28-9b80-c6855ec29832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32600f65-4eaf-4b28-9b80-c6855ec29832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb75ffa9-90e2-48b3-89d9-2d543ff5f300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.image.glance [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Creating Keystone auth plugin from conf {{(pid=87109) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 04:02:22 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1126ccd-7f27-4ca0-868d-3674d6a3d78d Nov 05 04:02:22 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5704b27e-6f4a-4a22-a2bc-3ddea8cd92fa tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-eb811d4b-61f6-4071-bc0a-d653de81d66a-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:22 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb Nov 05 04:02:22 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb75ffa9-90e2-48b3-89d9-2d543ff5f300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '077c960e-a1c7-4505-b34c-5e9e7350d62c', 'volume_name': 'volume-077c960e-a1c7-4505-b34c-5e9e7350d62c', 'volume_size': 1, 'image_id': '33d5cc96-6340-4ac3-b496-6ad243e10222', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33d5cc96-6340-4ac3-b496-6ad243e10222', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c533ed69a2b51e9f390baa028ec5a1b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '233f0cd6006f4650801b60c7b3791472', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7db329759335b2e3c9266df326d7152c6b4c4a571791aebd12ecea5351134c3aade1796f652945dea176dd79dceb05748f6df36d7de4c04af5508d9cdc3357f8', 'id': '33d5cc96-6340-4ac3-b496-6ad243e10222', 'created_at': datetime.datetime(2026, 11, 5, 3, 2, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 2, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33d5cc96-6340-4ac3-b496-6ad243e10222/file', 'properties': {}}, 'image_service': }' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (872788d7-51e1-455a-b73b-76b2fd3c30e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (872788d7-51e1-455a-b73b-76b2fd3c30e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80bcb023-caf6-4ce1-a702-06e35279b5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:23 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Volume 077c960e-a1c7-4505-b34c-5e9e7350d62c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-077c960e-a1c7-4505-b34c-5e9e7350d62c', 'volume_size': 1, 'image_id': '33d5cc96-6340-4ac3-b496-6ad243e10222', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33d5cc96-6340-4ac3-b496-6ad243e10222', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c533ed69a2b51e9f390baa028ec5a1b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '233f0cd6006f4650801b60c7b3791472', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7db329759335b2e3c9266df326d7152c6b4c4a571791aebd12ecea5351134c3aade1796f652945dea176dd79dceb05748f6df36d7de4c04af5508d9cdc3357f8', 'id': '33d5cc96-6340-4ac3-b496-6ad243e10222', 'created_at': datetime.datetime(2026, 11, 5, 3, 2, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 2, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33d5cc96-6340-4ac3-b496-6ad243e10222/file', 'properties': {}}, 'image_service': } Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Trying to clone 077c960e-a1c7-4505-b34c-5e9e7350d62c from image 33d5cc96-6340-4ac3-b496-6ad243e10222 at location (None, [{'url': 'file:///opt/stack/data/glance/images/33d5cc96-6340-4ac3-b496-6ad243e10222', 'metadata': {}}]). {{(pid=87109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 04:02:23 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb" returned: 0 in 0.264s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:23 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.081s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-303013714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b00d391-fa10-4de3-bfdd-9050623f797d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93c69acbac24c06a8467c24d2935536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:19Z,use_quota=True,user_id='0927b2fd243a4a3592e1eb4df07e5ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Creating volume 6b00d391-fa10-4de3-bfdd-9050623f797d {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:02:23 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6b00d391-fa10-4de3-bfdd-9050623f797d 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-79c492a8-ea2e-4d9f-ad7b-b925598a6cd7 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1126ccd-7f27-4ca0-868d-3674d6a3d78d" returned: 0 in 0.440s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-79c492a8-ea2e-4d9f-ad7b-b925598a6cd7 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1126ccd-7f27-4ca0-868d-3674d6a3d78d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:23 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6b00d391-fa10-4de3-bfdd-9050623f797d 1073741824 Nov 05 04:02:23 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4235c97-183c-449b-8754-c758c3ca878c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe0d3fbd-da4f-4a7c-985d-9bfe8f85d147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:23 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1126ccd-7f27-4ca0-868d-3674d6a3d78d Nov 05 04:02:23 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Nov 05 04:02:23 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Image download 0.00 MB at 0.00 MB/s Nov 05 04:02:23 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Volume volume-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb (e4b8297f-9b7b-4101-ad1b-79108bb0e8fb): created successfully Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe0d3fbd-da4f-4a7c-985d-9bfe8f85d147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Flow 'volume_create_manager' (1d4ebb2f-dd0d-4953-b5d4-1458ed0e03d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:23 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-1a262d1b-80b8-484e-82a1-4f3cde4c23c4 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Created volume successfully. Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c38f64-5582-453b-a183-761ac9c7fa40]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:23 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD Nov 05 04:02:23 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:23 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-79c492a8-ea2e-4d9f-ad7b-b925598a6cd7 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-c1126ccd-7f27-4ca0-868d-3674d6a3d78d" returned: 0 in 0.341s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-79c492a8-ea2e-4d9f-ad7b-b925598a6cd7 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-quobyte-c1126ccd-7f27-4ca0-868d-3674d6a3d78d" released by "delete_volume" :: held 0.833s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-79c492a8-ea2e-4d9f-ad7b-b925598a6cd7 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Created reservations ['3daddae2-5765-497b-8900-29c56dff59fd', '75495ebf-d682-4489-b5bd-7900866f7289', '95253ba8-dcce-4865-ac04-3765750365e3', '7acbe9df-1c4c-4c1f-8e6b-35e798f1cc7e'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-79c492a8-ea2e-4d9f-ad7b-b925598a6cd7 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-79c492a8-ea2e-4d9f-ad7b-b925598a6cd7 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-79c492a8-ea2e-4d9f-ad7b-b925598a6cd7 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-79c492a8-ea2e-4d9f-ad7b-b925598a6cd7 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-79c492a8-ea2e-4d9f-ad7b-b925598a6cd7 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-79c492a8-ea2e-4d9f-ad7b-b925598a6cd7 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:23 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:23 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:23 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:23 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6b00d391-fa10-4de3-bfdd-9050623f797d 1073741824" returned: 0 in 0.563s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6b00d391-fa10-4de3-bfdd-9050623f797d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:23 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6b00d391-fa10-4de3-bfdd-9050623f797d Nov 05 04:02:23 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-66447d90-eba9-4261-8e71-ff7649ba2371 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "cinder-26e58032-d0c9-47e7-b76d-7d5f21827182-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:23 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD Nov 05 04:02:23 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-66447d90-eba9-4261-8e71-ff7649ba2371 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-26e58032-d0c9-47e7-b76d-7d5f21827182-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-66447d90-eba9-4261-8e71-ff7649ba2371 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "cinder-quobyte-26e58032-d0c9-47e7-b76d-7d5f21827182" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:23 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-66447d90-eba9-4261-8e71-ff7649ba2371 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-quobyte-26e58032-d0c9-47e7-b76d-7d5f21827182" acquired by "delete_volume" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[8025dd1b-aef2-4f53-aec0-cbabec899bb4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-66447d90-eba9-4261-8e71-ff7649ba2371 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-26e58032-d0c9-47e7-b76d-7d5f21827182 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:24 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-79c492a8-ea2e-4d9f-ad7b-b925598a6cd7 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.343s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-79c492a8-ea2e-4d9f-ad7b-b925598a6cd7 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:24 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-79c492a8-ea2e-4d9f-ad7b-b925598a6cd7 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Deleted volume successfully. Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-79c492a8-ea2e-4d9f-ad7b-b925598a6cd7 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-c1126ccd-7f27-4ca0-868d-3674d6a3d78d-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:24 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD" returned: 1 in 0.412s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Temporary image 33d5cc96-6340-4ac3-b496-6ad243e10222 is fetched for user bdb0793bebc34e9d936dc8e82bdef32c. {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Nov 05 04:02:24 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6b00d391-fa10-4de3-bfdd-9050623f797d" returned: 0 in 0.363s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.237s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1032316268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a27761b2-1e5d-417e-8388-6ef59ab61342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f61cc92dd46408041e858fdab3dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:20Z,use_quota=True,user_id='840642882ebf4ec4ac16689c21ed946f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Creating volume a27761b2-1e5d-417e-8388-6ef59ab61342 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:02:24 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-26e58032-d0c9-47e7-b76d-7d5f21827182 Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:24 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:02:24 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:24 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342 1073741824 Nov 05 04:02:24 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c7005f1-56a3-41b1-9fb9-d4d39d698537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b00d391-fa10-4de3-bfdd-9050623f797d', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f1f30e-4dec-45c3-97b5-b1d3b800e69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:24 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Volume volume-6b00d391-fa10-4de3-bfdd-9050623f797d (6b00d391-fa10-4de3-bfdd-9050623f797d): created successfully Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f1f30e-4dec-45c3-97b5-b1d3b800e69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Flow 'volume_create_manager' (291ac1f1-a775-481c-b2c5-e03d257e9b39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[da89e9ec-0048-47d1-84e2-ccd31fc7fdac]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:24 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-4d9df343-8e57-4c28-b522-d736ea1701ff tempest-CreateVolumesFromSnapshotTest-2097811942 None] Created volume successfully. Nov 05 04:02:24 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD Nov 05 04:02:24 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:24 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-66447d90-eba9-4261-8e71-ff7649ba2371 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-26e58032-d0c9-47e7-b76d-7d5f21827182" returned: 0 in 0.452s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-66447d90-eba9-4261-8e71-ff7649ba2371 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-26e58032-d0c9-47e7-b76d-7d5f21827182 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:24 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-26e58032-d0c9-47e7-b76d-7d5f21827182 Nov 05 04:02:24 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-e3fd750a-ef72-4129-8c3b-a7539a18469d tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "cinder-6b00d391-fa10-4de3-bfdd-9050623f797d-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-e3fd750a-ef72-4129-8c3b-a7539a18469d tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-6b00d391-fa10-4de3-bfdd-9050623f797d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:24 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD" returned: 0 in 0.423s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:24 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342 1073741824" returned: 0 in 0.557s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-e3fd750a-ef72-4129-8c3b-a7539a18469d tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "cinder-quobyte-6b00d391-fa10-4de3-bfdd-9050623f797d" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-e3fd750a-ef72-4129-8c3b-a7539a18469d tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-quobyte-6b00d391-fa10-4de3-bfdd-9050623f797d" acquired by "delete_volume" :: waited 0.040s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:24 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342 Nov 05 04:02:24 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:24 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD Nov 05 04:02:24 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:24 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f7c909-7fa3-4df5-b65b-1d52943c10c7]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e3fd750a-ef72-4129-8c3b-a7539a18469d tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6b00d391-fa10-4de3-bfdd-9050623f797d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-66447d90-eba9-4261-8e71-ff7649ba2371 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-26e58032-d0c9-47e7-b76d-7d5f21827182" returned: 0 in 0.389s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-66447d90-eba9-4261-8e71-ff7649ba2371 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-quobyte-26e58032-d0c9-47e7-b76d-7d5f21827182" released by "delete_volume" :: held 0.910s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:24 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-66447d90-eba9-4261-8e71-ff7649ba2371 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Created reservations ['ad3a670f-3259-4b46-963d-cfa94898706d', 'ce6b1214-0341-4f18-8c13-4ee0250e560b', 'c707fa5c-8aa3-4cce-9270-01e92ad26055', '5460edd8-d97e-489b-8600-0e994784805c'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:24 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6b00d391-fa10-4de3-bfdd-9050623f797d Nov 05 04:02:24 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-66447d90-eba9-4261-8e71-ff7649ba2371 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-66447d90-eba9-4261-8e71-ff7649ba2371 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-66447d90-eba9-4261-8e71-ff7649ba2371 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-66447d90-eba9-4261-8e71-ff7649ba2371 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-66447d90-eba9-4261-8e71-ff7649ba2371 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-66447d90-eba9-4261-8e71-ff7649ba2371 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:25 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:25 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-11bce28d-8b17-4765-baa0-54aa45473819 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "cinder-2df28b4d-d1ad-4c4a-807d-77ad00534e29-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:25 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342" returned: 0 in 0.376s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f5c1da-a635-4f1c-8a12-46fac6fc4d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a27761b2-1e5d-417e-8388-6ef59ab61342', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:25 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a67c56-ad4c-433c-a2b0-983b32e93019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-11bce28d-8b17-4765-baa0-54aa45473819 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-2df28b4d-d1ad-4c4a-807d-77ad00534e29-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD" returned: 1 in 0.513s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=077c960e-a1c7-4505-b34c-5e9e7350d62c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='233f0cd6006f4650801b60c7b3791472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:23Z,use_quota=True,user_id='bdb0793bebc34e9d936dc8e82bdef32c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Creating volume 077c960e-a1c7-4505-b34c-5e9e7350d62c {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:02:25 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-077c960e-a1c7-4505-b34c-5e9e7350d62c 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:25 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-077c960e-a1c7-4505-b34c-5e9e7350d62c 1073741824 Nov 05 04:02:25 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:25 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Volume volume-a27761b2-1e5d-417e-8388-6ef59ab61342 (a27761b2-1e5d-417e-8388-6ef59ab61342): created successfully Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a67c56-ad4c-433c-a2b0-983b32e93019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Flow 'volume_create_manager' (9bbc1043-af22-4f4e-9fa9-1be201295b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:25 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-db4af97f-819c-4d53-9131-51e1ad5cb138 tempest-ProjectReaderTests-124678288 None] Created volume successfully. Nov 05 04:02:25 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:25 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e3fd750a-ef72-4129-8c3b-a7539a18469d tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6b00d391-fa10-4de3-bfdd-9050623f797d" returned: 0 in 0.526s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-66447d90-eba9-4261-8e71-ff7649ba2371 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.347s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e3fd750a-ef72-4129-8c3b-a7539a18469d tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6b00d391-fa10-4de3-bfdd-9050623f797d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-66447d90-eba9-4261-8e71-ff7649ba2371 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:25 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-66447d90-eba9-4261-8e71-ff7649ba2371 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Deleted volume successfully. Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-11bce28d-8b17-4765-baa0-54aa45473819 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "cinder-quobyte-2df28b4d-d1ad-4c4a-807d-77ad00534e29" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:25 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6b00d391-fa10-4de3-bfdd-9050623f797d Nov 05 04:02:25 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-11bce28d-8b17-4765-baa0-54aa45473819 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-quobyte-2df28b4d-d1ad-4c4a-807d-77ad00534e29" acquired by "delete_volume" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-66447d90-eba9-4261-8e71-ff7649ba2371 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-26e58032-d0c9-47e7-b76d-7d5f21827182-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5789b40d-430d-4f38-9fdc-345d8048338f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-11bce28d-8b17-4765-baa0-54aa45473819 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2df28b4d-d1ad-4c4a-807d-77ad00534e29 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:25 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2df28b4d-d1ad-4c4a-807d-77ad00534e29 Nov 05 04:02:25 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:25 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e3fd750a-ef72-4129-8c3b-a7539a18469d tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-6b00d391-fa10-4de3-bfdd-9050623f797d" returned: 0 in 0.291s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-e3fd750a-ef72-4129-8c3b-a7539a18469d tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-quobyte-6b00d391-fa10-4de3-bfdd-9050623f797d" released by "delete_volume" :: held 0.886s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:25 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-077c960e-a1c7-4505-b34c-5e9e7350d62c 1073741824" returned: 0 in 0.492s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-077c960e-a1c7-4505-b34c-5e9e7350d62c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-e3fd750a-ef72-4129-8c3b-a7539a18469d tempest-CreateVolumesFromSnapshotTest-2097811942 None] Created reservations ['55788661-7181-47ff-9441-203ee54536a1', 'e2f48e27-3039-446f-aa58-9de0c94c53ec', '4febc784-fa05-4f62-98dd-6a8321e7af71', 'bbe650e1-f782-4bdb-a10d-e38099762e0f'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:25 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-077c960e-a1c7-4505-b34c-5e9e7350d62c Nov 05 04:02:25 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e3fd750a-ef72-4129-8c3b-a7539a18469d tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e3fd750a-ef72-4129-8c3b-a7539a18469d tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e3fd750a-ef72-4129-8c3b-a7539a18469d tempest-CreateVolumesFromSnapshotTest-2097811942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e3fd750a-ef72-4129-8c3b-a7539a18469d tempest-CreateVolumesFromSnapshotTest-2097811942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e3fd750a-ef72-4129-8c3b-a7539a18469d tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e3fd750a-ef72-4129-8c3b-a7539a18469d tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:25 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:25 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:25 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-11bce28d-8b17-4765-baa0-54aa45473819 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2df28b4d-d1ad-4c4a-807d-77ad00534e29" returned: 0 in 0.457s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-11bce28d-8b17-4765-baa0-54aa45473819 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2df28b4d-d1ad-4c4a-807d-77ad00534e29 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:25 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2df28b4d-d1ad-4c4a-807d-77ad00534e29 Nov 05 04:02:25 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:26 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-077c960e-a1c7-4505-b34c-5e9e7350d62c" returned: 0 in 0.307s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Attempting download of 33d5cc96-6340-4ac3-b496-6ad243e10222 ((None, [{'url': 'file:///opt/stack/data/glance/images/33d5cc96-6340-4ac3-b496-6ad243e10222', 'metadata': {}}])) to volume 077c960e-a1c7-4505-b34c-5e9e7350d62c. {{(pid=87109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Nov 05 04:02:26 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e3fd750a-ef72-4129-8c3b-a7539a18469d tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.270s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-e3fd750a-ef72-4129-8c3b-a7539a18469d tempest-CreateVolumesFromSnapshotTest-2097811942 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[024e64d1-0453-41bd-8567-47c263d0da40]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33d5cc96-6340-4ac3-b496-6ad243e10222_bylbxil_ {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:26 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-e3fd750a-ef72-4129-8c3b-a7539a18469d tempest-CreateVolumesFromSnapshotTest-2097811942 None] Deleted volume successfully. Nov 05 04:02:26 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-11bce28d-8b17-4765-baa0-54aa45473819 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-2df28b4d-d1ad-4c4a-807d-77ad00534e29" returned: 0 in 0.290s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-e3fd750a-ef72-4129-8c3b-a7539a18469d tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-6b00d391-fa10-4de3-bfdd-9050623f797d-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-11bce28d-8b17-4765-baa0-54aa45473819 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-quobyte-2df28b4d-d1ad-4c4a-807d-77ad00534e29" released by "delete_volume" :: held 0.803s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:26 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33d5cc96-6340-4ac3-b496-6ad243e10222_bylbxil_ Nov 05 04:02:26 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-11bce28d-8b17-4765-baa0-54aa45473819 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Created reservations ['933cac50-6a28-40e1-8e44-2e7e0651614f', 'abd60643-dc7b-49bb-97f0-a1802659506d', '5403e830-f83b-45dc-a3a3-ff10bda62948', '7c0d79d0-fad9-400f-a6fd-3f3ae4652f45'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-11bce28d-8b17-4765-baa0-54aa45473819 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-11bce28d-8b17-4765-baa0-54aa45473819 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-11bce28d-8b17-4765-baa0-54aa45473819 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-11bce28d-8b17-4765-baa0-54aa45473819 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-11bce28d-8b17-4765-baa0-54aa45473819 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-11bce28d-8b17-4765-baa0-54aa45473819 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:26 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:26 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-41108d18-c53b-45af-b84a-e9fb73f8ed08 tempest-ProjectReaderTests-124678288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-41108d18-c53b-45af-b84a-e9fb73f8ed08 tempest-ProjectReaderTests-124678288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:26 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33d5cc96-6340-4ac3-b496-6ad243e10222_bylbxil_" returned: 0 in 0.425s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33d5cc96-6340-4ac3-b496-6ad243e10222_bylbxil_ {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-41108d18-c53b-45af-b84a-e9fb73f8ed08 tempest-ProjectReaderTests-124678288 None] Creating offline snapshot 2a9c083f-40e1-4eb2-87ef-e5df6bad79de of volume a27761b2-1e5d-417e-8388-6ef59ab61342 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c631e72-dc32-4365-990c-8b066d5add91]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-41108d18-c53b-45af-b84a-e9fb73f8ed08 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:26 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33d5cc96-6340-4ac3-b496-6ad243e10222_bylbxil_ Nov 05 04:02:26 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:26 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-11bce28d-8b17-4765-baa0-54aa45473819 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.324s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-11bce28d-8b17-4765-baa0-54aa45473819 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:26 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-11bce28d-8b17-4765-baa0-54aa45473819 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Deleted volume successfully. Nov 05 04:02:26 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342 Nov 05 04:02:26 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-11bce28d-8b17-4765-baa0-54aa45473819 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-2df28b4d-d1ad-4c4a-807d-77ad00534e29-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1c19274e-e5bb-40ba-917d-a477b6fa0c19 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "cinder-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1c19274e-e5bb-40ba-917d-a477b6fa0c19 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:26 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33d5cc96-6340-4ac3-b496-6ad243e10222_bylbxil_" returned: 1 in 0.389s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33d5cc96-6340-4ac3-b496-6ad243e10222_bylbxil_' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d7fe62-3d35-4428-82e7-d892bbe3ca33]: (4, 'raw') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1c19274e-e5bb-40ba-917d-a477b6fa0c19 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "cinder-quobyte-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1c19274e-e5bb-40ba-917d-a477b6fa0c19 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-quobyte-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb" acquired by "delete_volume" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[083d11ff-38df-48f8-93b2-4fd2ac07ab4c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1c19274e-e5bb-40ba-917d-a477b6fa0c19 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:27 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-41108d18-c53b-45af-b84a-e9fb73f8ed08 tempest-ProjectReaderTests-124678288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342" returned: 0 in 0.444s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-41108d18-c53b-45af-b84a-e9fb73f8ed08 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.2a9c083f-40e1-4eb2-87ef-e5df6bad79de 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:27 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD Nov 05 04:02:27 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:27 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.2a9c083f-40e1-4eb2-87ef-e5df6bad79de 1G Nov 05 04:02:27 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:27 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb Nov 05 04:02:27 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:27 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD" returned: 0 in 0.363s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3691539f-b8f2-4fe7-a1df-104ef1f89148 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "cinder-751dcd6c-418e-4b57-83f1-f624bddc7d77-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3691539f-b8f2-4fe7-a1df-104ef1f89148 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-751dcd6c-418e-4b57-83f1-f624bddc7d77-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:27 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1c19274e-e5bb-40ba-917d-a477b6fa0c19 tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb" returned: 0 in 0.435s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1c19274e-e5bb-40ba-917d-a477b6fa0c19 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:27 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD Nov 05 04:02:27 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:27 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb Nov 05 04:02:27 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3691539f-b8f2-4fe7-a1df-104ef1f89148 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "cinder-quobyte-751dcd6c-418e-4b57-83f1-f624bddc7d77" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3691539f-b8f2-4fe7-a1df-104ef1f89148 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-quobyte-751dcd6c-418e-4b57-83f1-f624bddc7d77" acquired by "delete_volume" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:27 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-41108d18-c53b-45af-b84a-e9fb73f8ed08 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.2a9c083f-40e1-4eb2-87ef-e5df6bad79de 1G" returned: 0 in 0.526s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-41108d18-c53b-45af-b84a-e9fb73f8ed08 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a27761b2-1e5d-417e-8388-6ef59ab61342 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.2a9c083f-40e1-4eb2-87ef-e5df6bad79de {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d644c6a-dd0e-4b9d-b79c-33c266a10e57]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3691539f-b8f2-4fe7-a1df-104ef1f89148 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-751dcd6c-418e-4b57-83f1-f624bddc7d77 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:27 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a27761b2-1e5d-417e-8388-6ef59ab61342 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.2a9c083f-40e1-4eb2-87ef-e5df6bad79de Nov 05 04:02:27 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:27 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-751dcd6c-418e-4b57-83f1-f624bddc7d77 Nov 05 04:02:27 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:27 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD" returned: 1 in 0.424s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD' failed. Not Retrying. {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] 33d5cc96-6340-4ac3-b496-6ad243e10222 was raw, converting to qcow2 {{(pid=87109) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-077c960e-a1c7-4505-b34c-5e9e7350d62c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:27 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1c19274e-e5bb-40ba-917d-a477b6fa0c19 tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb" returned: 0 in 0.311s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:27 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-077c960e-a1c7-4505-b34c-5e9e7350d62c Nov 05 04:02:27 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1c19274e-e5bb-40ba-917d-a477b6fa0c19 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-quobyte-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb" released by "delete_volume" :: held 0.795s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-1c19274e-e5bb-40ba-917d-a477b6fa0c19 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Created reservations ['4ff78567-e567-4bc4-858c-6147866bf184', 'b23d1329-a9d9-4e39-86b3-739572d27f0f', '3552ea27-68be-4cff-ac29-d33aaae527d5', '8ac6d24b-bc30-4adf-a46a-c7baa3ecc495'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:27 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-41108d18-c53b-45af-b84a-e9fb73f8ed08 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a27761b2-1e5d-417e-8388-6ef59ab61342 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.2a9c083f-40e1-4eb2-87ef-e5df6bad79de" returned: 0 in 0.349s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:27 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-41108d18-c53b-45af-b84a-e9fb73f8ed08 tempest-ProjectReaderTests-124678288 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.2a9c083f-40e1-4eb2-87ef-e5df6bad79de is being set with open permissions: ugo+rw Nov 05 04:02:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-41108d18-c53b-45af-b84a-e9fb73f8ed08 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.2a9c083f-40e1-4eb2-87ef-e5df6bad79de {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:27 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.2a9c083f-40e1-4eb2-87ef-e5df6bad79de Nov 05 04:02:27 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1c19274e-e5bb-40ba-917d-a477b6fa0c19 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1c19274e-e5bb-40ba-917d-a477b6fa0c19 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1c19274e-e5bb-40ba-917d-a477b6fa0c19 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-1c19274e-e5bb-40ba-917d-a477b6fa0c19 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1c19274e-e5bb-40ba-917d-a477b6fa0c19 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1c19274e-e5bb-40ba-917d-a477b6fa0c19 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:28 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:28 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:28 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3691539f-b8f2-4fe7-a1df-104ef1f89148 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-751dcd6c-418e-4b57-83f1-f624bddc7d77" returned: 0 in 0.495s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3691539f-b8f2-4fe7-a1df-104ef1f89148 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-751dcd6c-418e-4b57-83f1-f624bddc7d77 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:28 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-751dcd6c-418e-4b57-83f1-f624bddc7d77 Nov 05 04:02:28 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-51b56937-2256-4aec-8ff2-3afe957abe18 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "cinder-cbf763fe-cf55-44f3-bfcd-4875fb10ba22-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-51b56937-2256-4aec-8ff2-3afe957abe18 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-cbf763fe-cf55-44f3-bfcd-4875fb10ba22-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-51b56937-2256-4aec-8ff2-3afe957abe18 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "cinder-quobyte-cbf763fe-cf55-44f3-bfcd-4875fb10ba22" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-51b56937-2256-4aec-8ff2-3afe957abe18 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-quobyte-cbf763fe-cf55-44f3-bfcd-4875fb10ba22" acquired by "delete_volume" :: waited 0.026s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f315d8ff-8506-44c4-ba0e-154656ff23d7]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-51b56937-2256-4aec-8ff2-3afe957abe18 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-cbf763fe-cf55-44f3-bfcd-4875fb10ba22 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:28 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-41108d18-c53b-45af-b84a-e9fb73f8ed08 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.2a9c083f-40e1-4eb2-87ef-e5df6bad79de" returned: 0 in 0.426s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:28 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1c19274e-e5bb-40ba-917d-a477b6fa0c19 tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.397s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:28 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-1c19274e-e5bb-40ba-917d-a477b6fa0c19 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-077c960e-a1c7-4505-b34c-5e9e7350d62c" returned: 0 in 0.646s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-41108d18-c53b-45af-b84a-e9fb73f8ed08 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_33d5cc96-6340-4ac3-b496-6ad243e10222_d4i2ib16devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-077c960e-a1c7-4505-b34c-5e9e7350d62c {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 04:02:28 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-077c960e-a1c7-4505-b34c-5e9e7350d62c 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:28 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.info Nov 05 04:02:28 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:28 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-1c19274e-e5bb-40ba-917d-a477b6fa0c19 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Deleted volume successfully. Nov 05 04:02:28 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:28 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-cbf763fe-cf55-44f3-bfcd-4875fb10ba22 Nov 05 04:02:28 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3691539f-b8f2-4fe7-a1df-104ef1f89148 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-751dcd6c-418e-4b57-83f1-f624bddc7d77" returned: 0 in 0.362s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:28 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-077c960e-a1c7-4505-b34c-5e9e7350d62c 1G Nov 05 04:02:28 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3691539f-b8f2-4fe7-a1df-104ef1f89148 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-quobyte-751dcd6c-418e-4b57-83f1-f624bddc7d77" released by "delete_volume" :: held 0.924s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1c19274e-e5bb-40ba-917d-a477b6fa0c19 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-e4b8297f-9b7b-4101-ad1b-79108bb0e8fb-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-3691539f-b8f2-4fe7-a1df-104ef1f89148 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Created reservations ['f853bc10-7f69-428e-be81-00e872b4ca07', '7e64592e-177c-4131-a7fc-ac7ca2d063c2', '9a9c6fee-4407-450d-9aef-7e1bed7d3daf', '2bedc03b-6ecd-4d69-b69f-f96d0b1e669d'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3691539f-b8f2-4fe7-a1df-104ef1f89148 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3691539f-b8f2-4fe7-a1df-104ef1f89148 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3691539f-b8f2-4fe7-a1df-104ef1f89148 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3691539f-b8f2-4fe7-a1df-104ef1f89148 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3691539f-b8f2-4fe7-a1df-104ef1f89148 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3691539f-b8f2-4fe7-a1df-104ef1f89148 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:28 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:28 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:28 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-41108d18-c53b-45af-b84a-e9fb73f8ed08 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.info" returned: 0 in 0.355s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:28 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-41108d18-c53b-45af-b84a-e9fb73f8ed08 tempest-ProjectReaderTests-124678288 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.info is being set with open permissions: ugo+rw Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-41108d18-c53b-45af-b84a-e9fb73f8ed08 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:28 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-51b56937-2256-4aec-8ff2-3afe957abe18 tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-cbf763fe-cf55-44f3-bfcd-4875fb10ba22" returned: 0 in 0.484s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-51b56937-2256-4aec-8ff2-3afe957abe18 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-cbf763fe-cf55-44f3-bfcd-4875fb10ba22 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:28 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.info Nov 05 04:02:28 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:28 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-cbf763fe-cf55-44f3-bfcd-4875fb10ba22 Nov 05 04:02:28 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:28 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-077c960e-a1c7-4505-b34c-5e9e7350d62c 1G" returned: 0 in 0.431s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Downloaded image 33d5cc96-6340-4ac3-b496-6ad243e10222 ((None, [{'url': 'file:///opt/stack/data/glance/images/33d5cc96-6340-4ac3-b496-6ad243e10222', 'metadata': {}}])) to volume 077c960e-a1c7-4505-b34c-5e9e7350d62c successfully. {{(pid=87109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Temporary image 33d5cc96-6340-4ac3-b496-6ad243e10222 for user bdb0793bebc34e9d936dc8e82bdef32c is deleted. {{(pid=87109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG cinder.volume.volume_utils [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Marking volume 077c960e-a1c7-4505-b34c-5e9e7350d62c as bootable. {{(pid=87109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Copying metadata from image 33d5cc96-6340-4ac3-b496-6ad243e10222 to 077c960e-a1c7-4505-b34c-5e9e7350d62c. {{(pid=87109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Creating volume glance metadata for volume 077c960e-a1c7-4505-b34c-5e9e7350d62c backed by image 33d5cc96-6340-4ac3-b496-6ad243e10222 with: {'image_id': '33d5cc96-6340-4ac3-b496-6ad243e10222', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2c533ed69a2b51e9f390baa028ec5a1b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80bcb023-caf6-4ce1-a702-06e35279b5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-077c960e-a1c7-4505-b34c-5e9e7350d62c', 'volume_size': 1, 'image_id': '33d5cc96-6340-4ac3-b496-6ad243e10222', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33d5cc96-6340-4ac3-b496-6ad243e10222', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c533ed69a2b51e9f390baa028ec5a1b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '233f0cd6006f4650801b60c7b3791472', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7db329759335b2e3c9266df326d7152c6b4c4a571791aebd12ecea5351134c3aade1796f652945dea176dd79dceb05748f6df36d7de4c04af5508d9cdc3357f8', 'id': '33d5cc96-6340-4ac3-b496-6ad243e10222', 'created_at': datetime.datetime(2026, 11, 5, 3, 2, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 2, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33d5cc96-6340-4ac3-b496-6ad243e10222/file', 'properties': {}}, 'image_service': }' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:28 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee197143-2bd6-422a-bcb3-8dc40cb5fb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:28 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Volume volume-077c960e-a1c7-4505-b34c-5e9e7350d62c (077c960e-a1c7-4505-b34c-5e9e7350d62c): created successfully Nov 05 04:02:28 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee197143-2bd6-422a-bcb3-8dc40cb5fb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Flow 'volume_create_manager' (04cf8310-622f-411d-b190-117709ce705f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3691539f-b8f2-4fe7-a1df-104ef1f89148 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.310s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-3691539f-b8f2-4fe7-a1df-104ef1f89148 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:29 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-3691539f-b8f2-4fe7-a1df-104ef1f89148 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Deleted volume successfully. Nov 05 04:02:29 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-02e171c4-f0eb-4aa2-a46d-bd54b3e72b45 tempest-VolumeImageDependencyTests-1226976986 None] Created volume successfully. Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-3691539f-b8f2-4fe7-a1df-104ef1f89148 tempest-CreateVolumesFromSourceVolumeTest-1491249897 None] Lock "cinder-751dcd6c-418e-4b57-83f1-f624bddc7d77-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:29 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-41108d18-c53b-45af-b84a-e9fb73f8ed08 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.info" returned: 0 in 0.315s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:29 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-41108d18-c53b-45af-b84a-e9fb73f8ed08 tempest-ProjectReaderTests-124678288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.571s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-51b56937-2256-4aec-8ff2-3afe957abe18 tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-cbf763fe-cf55-44f3-bfcd-4875fb10ba22" returned: 0 in 0.330s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-51b56937-2256-4aec-8ff2-3afe957abe18 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-quobyte-cbf763fe-cf55-44f3-bfcd-4875fb10ba22" released by "delete_volume" :: held 0.880s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:29 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-41108d18-c53b-45af-b84a-e9fb73f8ed08 tempest-ProjectReaderTests-124678288 None] Create snapshot completed successfully Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-51b56937-2256-4aec-8ff2-3afe957abe18 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Created reservations ['651e60de-6ac7-403b-844e-f813349f2782', '25b841f5-827e-4cb7-8b2c-242f096b9577', '200f1115-ce21-403a-8db7-add1d96a4274', '93d40af0-9c59-4645-b010-c45531a33124'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-51b56937-2256-4aec-8ff2-3afe957abe18 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-51b56937-2256-4aec-8ff2-3afe957abe18 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-51b56937-2256-4aec-8ff2-3afe957abe18 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-51b56937-2256-4aec-8ff2-3afe957abe18 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-51b56937-2256-4aec-8ff2-3afe957abe18 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-51b56937-2256-4aec-8ff2-3afe957abe18 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2b0889ea-393f-4856-bb5b-01993af59ae0 tempest-VolumeImageDependencyTests-1226976986 None] Acquiring lock "cinder-077c960e-a1c7-4505-b34c-5e9e7350d62c-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:29 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:29 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2b0889ea-393f-4856-bb5b-01993af59ae0 tempest-VolumeImageDependencyTests-1226976986 None] Lock "cinder-077c960e-a1c7-4505-b34c-5e9e7350d62c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2b0889ea-393f-4856-bb5b-01993af59ae0 tempest-VolumeImageDependencyTests-1226976986 None] Acquiring lock "cinder-quobyte-077c960e-a1c7-4505-b34c-5e9e7350d62c" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2b0889ea-393f-4856-bb5b-01993af59ae0 tempest-VolumeImageDependencyTests-1226976986 None] Lock "cinder-quobyte-077c960e-a1c7-4505-b34c-5e9e7350d62c" acquired by "delete_volume" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5c240cf4-d18a-47e9-ae3e-8cddb104af16 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "cinder-709fe45f-3b38-4c12-bb01-c45ab7e32f3a-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5c240cf4-d18a-47e9-ae3e-8cddb104af16 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-709fe45f-3b38-4c12-bb01-c45ab7e32f3a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26fd7b4-4b4d-440c-a416-2cde327e9e47]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2b0889ea-393f-4856-bb5b-01993af59ae0 tempest-VolumeImageDependencyTests-1226976986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-077c960e-a1c7-4505-b34c-5e9e7350d62c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5c240cf4-d18a-47e9-ae3e-8cddb104af16 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "cinder-quobyte-709fe45f-3b38-4c12-bb01-c45ab7e32f3a" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5c240cf4-d18a-47e9-ae3e-8cddb104af16 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-quobyte-709fe45f-3b38-4c12-bb01-c45ab7e32f3a" acquired by "delete_volume" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[396affc5-23f0-498f-9115-829e54702395]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5c240cf4-d18a-47e9-ae3e-8cddb104af16 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-709fe45f-3b38-4c12-bb01-c45ab7e32f3a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:29 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-51b56937-2256-4aec-8ff2-3afe957abe18 tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.311s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-51b56937-2256-4aec-8ff2-3afe957abe18 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:29 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-077c960e-a1c7-4505-b34c-5e9e7350d62c Nov 05 04:02:29 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:29 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-51b56937-2256-4aec-8ff2-3afe957abe18 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Deleted volume successfully. Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-51b56937-2256-4aec-8ff2-3afe957abe18 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-cbf763fe-cf55-44f3-bfcd-4875fb10ba22-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:29 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-709fe45f-3b38-4c12-bb01-c45ab7e32f3a Nov 05 04:02:29 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:29 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2b0889ea-393f-4856-bb5b-01993af59ae0 tempest-VolumeImageDependencyTests-1226976986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-077c960e-a1c7-4505-b34c-5e9e7350d62c" returned: 0 in 0.464s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2b0889ea-393f-4856-bb5b-01993af59ae0 tempest-VolumeImageDependencyTests-1226976986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-077c960e-a1c7-4505-b34c-5e9e7350d62c {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-2a9c083f-40e1-4eb2-87ef-e5df6bad79de-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:29 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-077c960e-a1c7-4505-b34c-5e9e7350d62c Nov 05 04:02:29 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] Lock "cinder-2a9c083f-40e1-4eb2-87ef-e5df6bad79de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:29 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-quobyte-a27761b2-1e5d-417e-8388-6ef59ab61342" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-a27761b2-1e5d-417e-8388-6ef59ab61342" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-quobyte-2a9c083f-40e1-4eb2-87ef-e5df6bad79de" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-2a9c083f-40e1-4eb2-87ef-e5df6bad79de" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] Deleting offline snapshot 2a9c083f-40e1-4eb2-87ef-e5df6bad79de of volume a27761b2-1e5d-417e-8388-6ef59ab61342 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:02:30 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] snapshot_file for this snap is: volume-a27761b2-1e5d-417e-8388-6ef59ab61342.2a9c083f-40e1-4eb2-87ef-e5df6bad79de {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5c240cf4-d18a-47e9-ae3e-8cddb104af16 tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-709fe45f-3b38-4c12-bb01-c45ab7e32f3a" returned: 0 in 0.488s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5c240cf4-d18a-47e9-ae3e-8cddb104af16 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-709fe45f-3b38-4c12-bb01-c45ab7e32f3a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c134543d-496b-47bc-ae69-3d4d94ce0eca]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.2a9c083f-40e1-4eb2-87ef-e5df6bad79de {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:30 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-709fe45f-3b38-4c12-bb01-c45ab7e32f3a Nov 05 04:02:30 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:30 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.2a9c083f-40e1-4eb2-87ef-e5df6bad79de Nov 05 04:02:30 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:30 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2b0889ea-393f-4856-bb5b-01993af59ae0 tempest-VolumeImageDependencyTests-1226976986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-077c960e-a1c7-4505-b34c-5e9e7350d62c" returned: 0 in 0.283s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2b0889ea-393f-4856-bb5b-01993af59ae0 tempest-VolumeImageDependencyTests-1226976986 None] Lock "cinder-quobyte-077c960e-a1c7-4505-b34c-5e9e7350d62c" released by "delete_volume" :: held 0.825s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-2b0889ea-393f-4856-bb5b-01993af59ae0 tempest-VolumeImageDependencyTests-1226976986 None] Created reservations ['7f12dd1c-3f5e-4e99-b2b6-588e3116f9c0', 'c23db881-aab3-4bab-bf7d-38cfd5937408', '99a07a5b-9f1d-4a19-8bdc-808c6423ae8c', 'c3bef21e-0506-4ff8-a919-1ed7f26010f7'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:30 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5c240cf4-d18a-47e9-ae3e-8cddb104af16 tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-709fe45f-3b38-4c12-bb01-c45ab7e32f3a" returned: 0 in 0.319s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2b0889ea-393f-4856-bb5b-01993af59ae0 tempest-VolumeImageDependencyTests-1226976986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2b0889ea-393f-4856-bb5b-01993af59ae0 tempest-VolumeImageDependencyTests-1226976986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2b0889ea-393f-4856-bb5b-01993af59ae0 tempest-VolumeImageDependencyTests-1226976986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2b0889ea-393f-4856-bb5b-01993af59ae0 tempest-VolumeImageDependencyTests-1226976986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2b0889ea-393f-4856-bb5b-01993af59ae0 tempest-VolumeImageDependencyTests-1226976986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2b0889ea-393f-4856-bb5b-01993af59ae0 tempest-VolumeImageDependencyTests-1226976986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5c240cf4-d18a-47e9-ae3e-8cddb104af16 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-quobyte-709fe45f-3b38-4c12-bb01-c45ab7e32f3a" released by "delete_volume" :: held 0.884s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:30 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:30 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-5c240cf4-d18a-47e9-ae3e-8cddb104af16 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Created reservations ['2a5487c1-b113-4f37-9702-08f9b8c45c84', 'cad4b025-346a-45ed-9a3a-cb9bab2289ac', '55b8b1e4-7b60-4ae3-b2e2-0b0e8de677d8', '251e8b05-fbd7-4b53-afcb-719d3660649d'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:30 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.2a9c083f-40e1-4eb2-87ef-e5df6bad79de" returned: 0 in 0.515s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a27761b2-1e5d-417e-8388-6ef59ab61342(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c274be-e5f1-43de-bbf6-f767a973c2b8]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5c240cf4-d18a-47e9-ae3e-8cddb104af16 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5c240cf4-d18a-47e9-ae3e-8cddb104af16 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5c240cf4-d18a-47e9-ae3e-8cddb104af16 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5c240cf4-d18a-47e9-ae3e-8cddb104af16 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5c240cf4-d18a-47e9-ae3e-8cddb104af16 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5c240cf4-d18a-47e9-ae3e-8cddb104af16 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:30 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:30 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:30 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342 Nov 05 04:02:30 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:30 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2b0889ea-393f-4856-bb5b-01993af59ae0 tempest-VolumeImageDependencyTests-1226976986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.449s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-2b0889ea-393f-4856-bb5b-01993af59ae0 tempest-VolumeImageDependencyTests-1226976986 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:30 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-2b0889ea-393f-4856-bb5b-01993af59ae0 tempest-VolumeImageDependencyTests-1226976986 None] Deleted volume successfully. Nov 05 04:02:30 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-2b0889ea-393f-4856-bb5b-01993af59ae0 tempest-VolumeImageDependencyTests-1226976986 None] Lock "cinder-077c960e-a1c7-4505-b34c-5e9e7350d62c-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:31 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5c240cf4-d18a-47e9-ae3e-8cddb104af16 tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.402s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:31 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-5c240cf4-d18a-47e9-ae3e-8cddb104af16 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:31 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5c240cf4-d18a-47e9-ae3e-8cddb104af16 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Deleted volume successfully. Nov 05 04:02:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5c240cf4-d18a-47e9-ae3e-8cddb104af16 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-709fe45f-3b38-4c12-bb01-c45ab7e32f3a-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:31 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342" returned: 0 in 0.530s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.2a9c083f-40e1-4eb2-87ef-e5df6bad79de {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:31 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.2a9c083f-40e1-4eb2-87ef-e5df6bad79de Nov 05 04:02:31 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:31 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.2a9c083f-40e1-4eb2-87ef-e5df6bad79de" returned: 0 in 0.412s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.2a9c083f-40e1-4eb2-87ef-e5df6bad79de {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:31 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.2a9c083f-40e1-4eb2-87ef-e5df6bad79de Nov 05 04:02:31 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-37601d9c-5270-4d8a-a35b-460cc7f2cff6 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "cinder-fcba5403-2f75-43b0-b60b-3ac08a104cd6-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-37601d9c-5270-4d8a-a35b-460cc7f2cff6 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-fcba5403-2f75-43b0-b60b-3ac08a104cd6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-37601d9c-5270-4d8a-a35b-460cc7f2cff6 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "cinder-quobyte-fcba5403-2f75-43b0-b60b-3ac08a104cd6" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-37601d9c-5270-4d8a-a35b-460cc7f2cff6 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-quobyte-fcba5403-2f75-43b0-b60b-3ac08a104cd6" acquired by "delete_volume" :: waited 0.035s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:31 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efe82cb-8518-4928-8250-cb3c7ba18c44]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-37601d9c-5270-4d8a-a35b-460cc7f2cff6 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fcba5403-2f75-43b0-b60b-3ac08a104cd6 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:31 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342.2a9c083f-40e1-4eb2-87ef-e5df6bad79de" returned: 0 in 0.377s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-2a9c083f-40e1-4eb2-87ef-e5df6bad79de" released by "_delete_snapshot" :: held 1.995s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-a27761b2-1e5d-417e-8388-6ef59ab61342" released by "delete_snapshot" :: held 2.030s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:32 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fcba5403-2f75-43b0-b60b-3ac08a104cd6 Nov 05 04:02:32 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:32 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] Created reservations ['cd034a78-30e0-47bd-ac91-4466d4bf6ec2', 'cf440629-81f2-491e-b96b-079bc0ea9d43', '21710601-0ca3-4975-b0e6-be1a6580ba4e', 'dff09b1f-ef78-4f86-8a0e-5218bfb7c763'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:32 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] Delete snapshot completed successfully. Nov 05 04:02:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cdd5dc46-774c-4460-907d-662f3502dbfb tempest-ProjectReaderTests-124678288 None] Lock "cinder-2a9c083f-40e1-4eb2-87ef-e5df6bad79de-delete_snapshot" released by "delete_snapshot" :: held 2.265s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:32 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-37601d9c-5270-4d8a-a35b-460cc7f2cff6 tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fcba5403-2f75-43b0-b60b-3ac08a104cd6" returned: 0 in 0.505s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-37601d9c-5270-4d8a-a35b-460cc7f2cff6 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fcba5403-2f75-43b0-b60b-3ac08a104cd6 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:32 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fcba5403-2f75-43b0-b60b-3ac08a104cd6 Nov 05 04:02:32 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:32 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-37601d9c-5270-4d8a-a35b-460cc7f2cff6 tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fcba5403-2f75-43b0-b60b-3ac08a104cd6" returned: 0 in 0.288s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-37601d9c-5270-4d8a-a35b-460cc7f2cff6 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-quobyte-fcba5403-2f75-43b0-b60b-3ac08a104cd6" released by "delete_volume" :: held 0.852s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:32 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-37601d9c-5270-4d8a-a35b-460cc7f2cff6 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Created reservations ['12a6a7d3-15dc-47da-a0f7-af6daf3ec077', 'ddc7397c-3133-4007-a7de-5147a858e955', 'c6e9baa2-8f69-475e-92ba-3ad9e2f0aab9', '2f008d88-c1e8-49fa-824e-a18fe1dfae3e'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-37601d9c-5270-4d8a-a35b-460cc7f2cff6 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-37601d9c-5270-4d8a-a35b-460cc7f2cff6 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-37601d9c-5270-4d8a-a35b-460cc7f2cff6 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-37601d9c-5270-4d8a-a35b-460cc7f2cff6 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-37601d9c-5270-4d8a-a35b-460cc7f2cff6 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-37601d9c-5270-4d8a-a35b-460cc7f2cff6 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:32 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:32 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "cinder-feb18ee5-bcad-4fb7-888c-0d8df9967329-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-feb18ee5-bcad-4fb7-888c-0d8df9967329-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "cinder-quobyte-e0f4153b-ebbc-487a-8013-3e6cb534148e" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-quobyte-e0f4153b-ebbc-487a-8013-3e6cb534148e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "cinder-quobyte-feb18ee5-bcad-4fb7-888c-0d8df9967329" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-quobyte-feb18ee5-bcad-4fb7-888c-0d8df9967329" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] Deleting offline snapshot feb18ee5-bcad-4fb7-888c-0d8df9967329 of volume e0f4153b-ebbc-487a-8013-3e6cb534148e {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] snapshot_file for this snap is: volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.feb18ee5-bcad-4fb7-888c-0d8df9967329 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e133fb-82f1-4763-8288-f6c7932daa86]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.feb18ee5-bcad-4fb7-888c-0d8df9967329 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:33 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-37601d9c-5270-4d8a-a35b-460cc7f2cff6 tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.373s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-37601d9c-5270-4d8a-a35b-460cc7f2cff6 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6c30ce1d-5d96-49e2-906a-46b5491aabc9 tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-a27761b2-1e5d-417e-8388-6ef59ab61342-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:33 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-37601d9c-5270-4d8a-a35b-460cc7f2cff6 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Deleted volume successfully. Nov 05 04:02:33 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.feb18ee5-bcad-4fb7-888c-0d8df9967329 Nov 05 04:02:33 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-37601d9c-5270-4d8a-a35b-460cc7f2cff6 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-fcba5403-2f75-43b0-b60b-3ac08a104cd6-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6c30ce1d-5d96-49e2-906a-46b5491aabc9 tempest-ProjectReaderTests-124678288 None] Lock "cinder-a27761b2-1e5d-417e-8388-6ef59ab61342-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6c30ce1d-5d96-49e2-906a-46b5491aabc9 tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-quobyte-a27761b2-1e5d-417e-8388-6ef59ab61342" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6c30ce1d-5d96-49e2-906a-46b5491aabc9 tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-a27761b2-1e5d-417e-8388-6ef59ab61342" acquired by "delete_volume" :: waited 0.032s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[90542873-cfb7-46e0-a7c6-a9cb747bbded]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6c30ce1d-5d96-49e2-906a-46b5491aabc9 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:33 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.feb18ee5-bcad-4fb7-888c-0d8df9967329" returned: 0 in 0.594s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0f4153b-ebbc-487a-8013-3e6cb534148e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:02:33 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342 Nov 05 04:02:33 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db11c60-572c-4013-af5b-ce2878d020ab]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:33 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e Nov 05 04:02:33 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:34 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6c30ce1d-5d96-49e2-906a-46b5491aabc9 tempest-ProjectReaderTests-124678288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342" returned: 0 in 0.506s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6c30ce1d-5d96-49e2-906a-46b5491aabc9 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:34 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342 Nov 05 04:02:34 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:34 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e" returned: 0 in 0.555s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.feb18ee5-bcad-4fb7-888c-0d8df9967329 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:34 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.feb18ee5-bcad-4fb7-888c-0d8df9967329 Nov 05 04:02:34 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:34 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6c30ce1d-5d96-49e2-906a-46b5491aabc9 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a27761b2-1e5d-417e-8388-6ef59ab61342" returned: 0 in 0.434s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6c30ce1d-5d96-49e2-906a-46b5491aabc9 tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-a27761b2-1e5d-417e-8388-6ef59ab61342" released by "delete_volume" :: held 1.053s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:34 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-6c30ce1d-5d96-49e2-906a-46b5491aabc9 tempest-ProjectReaderTests-124678288 None] Created reservations ['f3fb5aba-4f35-400f-ae82-d32d7145cf3a', '3973f636-37cf-4b8f-9eb0-5807bfe07ca2', '424b122f-7d35-4419-952b-c66a1cb16308', '134afd55-fcf7-423d-ad27-5af9909c49db'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6c30ce1d-5d96-49e2-906a-46b5491aabc9 tempest-ProjectReaderTests-124678288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6c30ce1d-5d96-49e2-906a-46b5491aabc9 tempest-ProjectReaderTests-124678288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6c30ce1d-5d96-49e2-906a-46b5491aabc9 tempest-ProjectReaderTests-124678288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6c30ce1d-5d96-49e2-906a-46b5491aabc9 tempest-ProjectReaderTests-124678288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6c30ce1d-5d96-49e2-906a-46b5491aabc9 tempest-ProjectReaderTests-124678288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6c30ce1d-5d96-49e2-906a-46b5491aabc9 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:34 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:34 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:34 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.feb18ee5-bcad-4fb7-888c-0d8df9967329" returned: 0 in 0.549s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.feb18ee5-bcad-4fb7-888c-0d8df9967329 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:34 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.feb18ee5-bcad-4fb7-888c-0d8df9967329 Nov 05 04:02:34 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:35 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6c30ce1d-5d96-49e2-906a-46b5491aabc9 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.349s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-6c30ce1d-5d96-49e2-906a-46b5491aabc9 tempest-ProjectReaderTests-124678288 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:35 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-6c30ce1d-5d96-49e2-906a-46b5491aabc9 tempest-ProjectReaderTests-124678288 None] Deleted volume successfully. Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6c30ce1d-5d96-49e2-906a-46b5491aabc9 tempest-ProjectReaderTests-124678288 None] Lock "cinder-a27761b2-1e5d-417e-8388-6ef59ab61342-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:35 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e.feb18ee5-bcad-4fb7-888c-0d8df9967329" returned: 0 in 0.411s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-quobyte-feb18ee5-bcad-4fb7-888c-0d8df9967329" released by "_delete_snapshot" :: held 2.253s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-quobyte-e0f4153b-ebbc-487a-8013-3e6cb534148e" released by "delete_snapshot" :: held 2.283s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] Created reservations ['566319b9-edb7-4eac-8b46-6d631726513e', '21352833-f6bd-4957-8045-196aa5d36ca0', '79f29ecf-d1c4-4d9a-b026-3d51e93bf5c9', 'ef11a655-9bb4-4442-bed3-b88446a45aa0'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Flow 'volume_create_manager' (6d1e1dba-a73a-48ea-a04c-569a66222508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724b8770-3eff-4281-a510-1b9cf9a187f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724b8770-3eff-4281-a510-1b9cf9a187f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1855737507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f065bc4-491a-4b7c-8041-af6cde38980b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f61cc92dd46408041e858fdab3dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:35Z,use_quota=True,user_id='840642882ebf4ec4ac16689c21ed946f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a89952c-67fb-44c9-9ba7-bead870b4f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a89952c-67fb-44c9-9ba7-bead870b4f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45587d2a-905f-49b2-8055-eedb0072c9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45587d2a-905f-49b2-8055-eedb0072c9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f065bc4-491a-4b7c-8041-af6cde38980b', 'volume_name': 'volume-8f065bc4-491a-4b7c-8041-af6cde38980b', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba96b56d-a418-4345-a5a3-3dbf3199ddaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba96b56d-a418-4345-a5a3-3dbf3199ddaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b4237a-afeb-482e-ac95-0a5c54020158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:35 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Volume 8f065bc4-491a-4b7c-8041-af6cde38980b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f065bc4-491a-4b7c-8041-af6cde38980b', 'volume_size': 1} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1855737507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f065bc4-491a-4b7c-8041-af6cde38980b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f61cc92dd46408041e858fdab3dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:35Z,use_quota=True,user_id='840642882ebf4ec4ac16689c21ed946f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Creating volume 8f065bc4-491a-4b7c-8041-af6cde38980b {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:02:35 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:35 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b 1073741824 Nov 05 04:02:35 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:35 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] Delete snapshot completed successfully. Nov 05 04:02:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-cf4e6e1b-735e-4898-8d5d-9e584b63608f tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-feb18ee5-bcad-4fb7-888c-0d8df9967329-delete_snapshot" released by "delete_snapshot" :: held 2.639s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:36 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b 1073741824" returned: 0 in 0.521s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:36 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b Nov 05 04:02:36 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5055e140-7fe7-455a-ae2c-96a5b39d2b86 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "cinder-e0f4153b-ebbc-487a-8013-3e6cb534148e-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5055e140-7fe7-455a-ae2c-96a5b39d2b86 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-e0f4153b-ebbc-487a-8013-3e6cb534148e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5055e140-7fe7-455a-ae2c-96a5b39d2b86 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "cinder-quobyte-e0f4153b-ebbc-487a-8013-3e6cb534148e" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:36 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b" returned: 0 in 0.348s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:02:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5055e140-7fe7-455a-ae2c-96a5b39d2b86 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-quobyte-e0f4153b-ebbc-487a-8013-3e6cb534148e" acquired by "delete_volume" :: waited 0.023s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b4237a-afeb-482e-ac95-0a5c54020158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f065bc4-491a-4b7c-8041-af6cde38980b', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fce32cd-64b2-4326-9a4a-3a384aab82f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:36 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[90090935-47e6-4593-95e8-0b209223f3f0]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5055e140-7fe7-455a-ae2c-96a5b39d2b86 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:36 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Volume volume-8f065bc4-491a-4b7c-8041-af6cde38980b (8f065bc4-491a-4b7c-8041-af6cde38980b): created successfully Nov 05 04:02:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fce32cd-64b2-4326-9a4a-3a384aab82f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:36 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Flow 'volume_create_manager' (6d1e1dba-a73a-48ea-a04c-569a66222508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:36 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-12f19583-91a5-41ad-99c8-8cfc25b7fcd3 tempest-ProjectReaderTests-124678288 None] Created volume successfully. Nov 05 04:02:36 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e Nov 05 04:02:36 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:37 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5055e140-7fe7-455a-ae2c-96a5b39d2b86 tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e" returned: 0 in 0.410s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5055e140-7fe7-455a-ae2c-96a5b39d2b86 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:37 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e Nov 05 04:02:37 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:37 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5055e140-7fe7-455a-ae2c-96a5b39d2b86 tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0f4153b-ebbc-487a-8013-3e6cb534148e" returned: 0 in 0.281s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5055e140-7fe7-455a-ae2c-96a5b39d2b86 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-quobyte-e0f4153b-ebbc-487a-8013-3e6cb534148e" released by "delete_volume" :: held 0.792s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:37 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-5055e140-7fe7-455a-ae2c-96a5b39d2b86 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Created reservations ['54a68b78-4b4e-4a80-91de-05e0fa75e5e4', '41d56869-388d-4f27-be29-c1c237b1cc5e', '8a79de01-2c07-40af-a173-d9003872d8bf', '8f4fb4e4-7c21-4b24-b050-019e81076ba7'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5055e140-7fe7-455a-ae2c-96a5b39d2b86 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5055e140-7fe7-455a-ae2c-96a5b39d2b86 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5055e140-7fe7-455a-ae2c-96a5b39d2b86 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-5055e140-7fe7-455a-ae2c-96a5b39d2b86 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-5055e140-7fe7-455a-ae2c-96a5b39d2b86 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5055e140-7fe7-455a-ae2c-96a5b39d2b86 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:37 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:37 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d80cc650-0faf-47a3-8067-a0c0f6a92ca0 tempest-ProjectReaderTests-124678288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d80cc650-0faf-47a3-8067-a0c0f6a92ca0 tempest-ProjectReaderTests-124678288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-d80cc650-0faf-47a3-8067-a0c0f6a92ca0 tempest-ProjectReaderTests-124678288 None] Creating offline snapshot d0f6ded2-a416-4eae-80e6-a6437c08b10a of volume 8f065bc4-491a-4b7c-8041-af6cde38980b {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:02:37 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9035ac2-af8d-4a28-8565-afd8cbc7cc33]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d80cc650-0faf-47a3-8067-a0c0f6a92ca0 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:38 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-5055e140-7fe7-455a-ae2c-96a5b39d2b86 tempest-CreateVolumesFromSnapshotTest-2097811942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.388s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:38 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-5055e140-7fe7-455a-ae2c-96a5b39d2b86 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:38 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-5055e140-7fe7-455a-ae2c-96a5b39d2b86 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Deleted volume successfully. Nov 05 04:02:38 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-5055e140-7fe7-455a-ae2c-96a5b39d2b86 tempest-CreateVolumesFromSnapshotTest-2097811942 None] Lock "cinder-e0f4153b-ebbc-487a-8013-3e6cb534148e-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:38 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b Nov 05 04:02:38 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:38 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d80cc650-0faf-47a3-8067-a0c0f6a92ca0 tempest-ProjectReaderTests-124678288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b" returned: 0 in 0.554s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d80cc650-0faf-47a3-8067-a0c0f6a92ca0 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.d0f6ded2-a416-4eae-80e6-a6437c08b10a 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:38 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.d0f6ded2-a416-4eae-80e6-a6437c08b10a 1G Nov 05 04:02:38 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:39 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d80cc650-0faf-47a3-8067-a0c0f6a92ca0 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.d0f6ded2-a416-4eae-80e6-a6437c08b10a 1G" returned: 0 in 0.597s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d80cc650-0faf-47a3-8067-a0c0f6a92ca0 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f065bc4-491a-4b7c-8041-af6cde38980b -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.d0f6ded2-a416-4eae-80e6-a6437c08b10a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:39 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f065bc4-491a-4b7c-8041-af6cde38980b -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.d0f6ded2-a416-4eae-80e6-a6437c08b10a Nov 05 04:02:39 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:39 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d80cc650-0faf-47a3-8067-a0c0f6a92ca0 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f065bc4-491a-4b7c-8041-af6cde38980b -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.d0f6ded2-a416-4eae-80e6-a6437c08b10a" returned: 0 in 0.382s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:39 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-d80cc650-0faf-47a3-8067-a0c0f6a92ca0 tempest-ProjectReaderTests-124678288 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.d0f6ded2-a416-4eae-80e6-a6437c08b10a is being set with open permissions: ugo+rw Nov 05 04:02:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d80cc650-0faf-47a3-8067-a0c0f6a92ca0 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.d0f6ded2-a416-4eae-80e6-a6437c08b10a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:39 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.d0f6ded2-a416-4eae-80e6-a6437c08b10a Nov 05 04:02:39 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:39 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d80cc650-0faf-47a3-8067-a0c0f6a92ca0 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.d0f6ded2-a416-4eae-80e6-a6437c08b10a" returned: 0 in 0.316s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d80cc650-0faf-47a3-8067-a0c0f6a92ca0 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:39 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.info Nov 05 04:02:39 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:40 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d80cc650-0faf-47a3-8067-a0c0f6a92ca0 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.info" returned: 0 in 0.271s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:40 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-d80cc650-0faf-47a3-8067-a0c0f6a92ca0 tempest-ProjectReaderTests-124678288 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.info is being set with open permissions: ugo+rw Nov 05 04:02:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d80cc650-0faf-47a3-8067-a0c0f6a92ca0 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:40 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.info Nov 05 04:02:40 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:40 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d80cc650-0faf-47a3-8067-a0c0f6a92ca0 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.info" returned: 0 in 0.282s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d80cc650-0faf-47a3-8067-a0c0f6a92ca0 tempest-ProjectReaderTests-124678288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.520s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:40 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-d80cc650-0faf-47a3-8067-a0c0f6a92ca0 tempest-ProjectReaderTests-124678288 None] Create snapshot completed successfully Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-d0f6ded2-a416-4eae-80e6-a6437c08b10a-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] Lock "cinder-d0f6ded2-a416-4eae-80e6-a6437c08b10a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-quobyte-8f065bc4-491a-4b7c-8041-af6cde38980b" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-8f065bc4-491a-4b7c-8041-af6cde38980b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-quobyte-d0f6ded2-a416-4eae-80e6-a6437c08b10a" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-d0f6ded2-a416-4eae-80e6-a6437c08b10a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] Deleting offline snapshot d0f6ded2-a416-4eae-80e6-a6437c08b10a of volume 8f065bc4-491a-4b7c-8041-af6cde38980b {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] snapshot_file for this snap is: volume-8f065bc4-491a-4b7c-8041-af6cde38980b.d0f6ded2-a416-4eae-80e6-a6437c08b10a {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[292cb114-7daa-4dbf-b0ed-56c7d10cfc7d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.d0f6ded2-a416-4eae-80e6-a6437c08b10a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:41 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.d0f6ded2-a416-4eae-80e6-a6437c08b10a Nov 05 04:02:41 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:41 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.d0f6ded2-a416-4eae-80e6-a6437c08b10a" returned: 0 in 0.554s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f065bc4-491a-4b7c-8041-af6cde38980b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44f6735-91fa-4218-974e-d33219eff933]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Flow 'volume_create_manager' (9b137e15-3e7c-4c47-ade8-c2e707940c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8405360-a449-44bf-866a-aab5fcb33558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:41 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b Nov 05 04:02:41 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8405360-a449-44bf-866a-aab5fcb33558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1518529327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dbe05d3-fc31-4286-89b6-1d3dac95c8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3010d6d3e434042bd27e53719a4555c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:42Z,use_quota=True,user_id='7b969d6cb8a54a0fb326f742289e9663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b7016c3-b529-4647-bd71-2567fa680cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b7016c3-b529-4647-bd71-2567fa680cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ca1ef1-c682-414c-a324-1077192fdc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:41 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ca1ef1-c682-414c-a324-1077192fdc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dbe05d3-fc31-4286-89b6-1d3dac95c8a2', 'volume_name': 'volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b358d965-35bc-4583-807c-285cf2007e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b358d965-35bc-4583-807c-285cf2007e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca37b50-fa08-4631-8aa6-bbc1767a19bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:42 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Volume 1dbe05d3-fc31-4286-89b6-1d3dac95c8a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2', 'volume_size': 1} Nov 05 04:02:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:42 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1518529327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dbe05d3-fc31-4286-89b6-1d3dac95c8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3010d6d3e434042bd27e53719a4555c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:42Z,use_quota=True,user_id='7b969d6cb8a54a0fb326f742289e9663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:02:42 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Creating volume 1dbe05d3-fc31-4286-89b6-1d3dac95c8a2 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:02:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:42 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:42 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:42 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:02:42 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:02:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:42 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2 1073741824 Nov 05 04:02:42 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:42 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b" returned: 0 in 0.413s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.d0f6ded2-a416-4eae-80e6-a6437c08b10a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:42 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.d0f6ded2-a416-4eae-80e6-a6437c08b10a Nov 05 04:02:42 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-24bed61a-9762-446a-8c30-b96b36146bb3 tempest-ProjectAdminTests-1254613295 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5555381774902, 'free_capacity_gb': 1773.5555381774902, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87109) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4851}} Nov 05 04:02:42 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2 1073741824" returned: 0 in 0.581s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:42 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2 Nov 05 04:02:42 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:42 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.d0f6ded2-a416-4eae-80e6-a6437c08b10a" returned: 0 in 0.474s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.d0f6ded2-a416-4eae-80e6-a6437c08b10a {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:42 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.d0f6ded2-a416-4eae-80e6-a6437c08b10a Nov 05 04:02:42 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:43 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2" returned: 0 in 0.351s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:43 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:02:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:43 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca37b50-fa08-4631-8aa6-bbc1767a19bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:43 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9390356a-8301-485f-8102-45f1d28ac2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:43 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Volume volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2 (1dbe05d3-fc31-4286-89b6-1d3dac95c8a2): created successfully Nov 05 04:02:43 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9390356a-8301-485f-8102-45f1d28ac2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:43 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Flow 'volume_create_manager' (9b137e15-3e7c-4c47-ade8-c2e707940c4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:43 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-e8b5f47b-38ec-40b0-a3b4-e22d9ce5736f tempest-ProjectMemberTests-1074212560 None] Created volume successfully. Nov 05 04:02:43 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b.d0f6ded2-a416-4eae-80e6-a6437c08b10a" returned: 0 in 0.382s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-d0f6ded2-a416-4eae-80e6-a6437c08b10a" released by "_delete_snapshot" :: held 1.964s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-8f065bc4-491a-4b7c-8041-af6cde38980b" released by "delete_snapshot" :: held 1.991s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:43 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] Created reservations ['2b802058-b128-4c64-a459-45bd29b7d717', 'edc3f254-9664-444f-b34e-5798a47feeee', 'fe5959d7-ee58-4219-971e-a577f870473d', 'db0e4c0d-eecb-4f67-9c3f-61077f424da8'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:43 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] Delete snapshot completed successfully. Nov 05 04:02:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6041d4fd-70b8-4750-95c3-36c0a18a21cb tempest-ProjectReaderTests-124678288 None] Lock "cinder-d0f6ded2-a416-4eae-80e6-a6437c08b10a-delete_snapshot" released by "delete_snapshot" :: held 2.187s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:44 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=259,cinder:UPDATE=308,cinder:INSERT=77,cinder:DELETE=27 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:02:44 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:UPDATE=310,cinder:SELECT=243,cinder:INSERT=89,cinder:DELETE=28 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:02:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8a0c704e-cfb9-414a-bddf-8c5e56b37253 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8a0c704e-cfb9-414a-bddf-8c5e56b37253 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-13b80ed0-e9b3-4744-bc04-a234599b0891 tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-8f065bc4-491a-4b7c-8041-af6cde38980b-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-8a0c704e-cfb9-414a-bddf-8c5e56b37253 tempest-ProjectMemberTests-1074212560 None] Creating offline snapshot ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8 of volume 1dbe05d3-fc31-4286-89b6-1d3dac95c8a2 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:02:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-13b80ed0-e9b3-4744-bc04-a234599b0891 tempest-ProjectReaderTests-124678288 None] Lock "cinder-8f065bc4-491a-4b7c-8041-af6cde38980b-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:44 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0c45c5-d100-4752-bede-08ee56fc1115]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a0c704e-cfb9-414a-bddf-8c5e56b37253 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-13b80ed0-e9b3-4744-bc04-a234599b0891 tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-quobyte-8f065bc4-491a-4b7c-8041-af6cde38980b" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-13b80ed0-e9b3-4744-bc04-a234599b0891 tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-8f065bc4-491a-4b7c-8041-af6cde38980b" acquired by "delete_volume" :: waited 0.025s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:44 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fc02b5-7a2b-4226-b79b-a38c2ca550f0]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-13b80ed0-e9b3-4744-bc04-a234599b0891 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:44 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2 Nov 05 04:02:44 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:44 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b Nov 05 04:02:44 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:45 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a0c704e-cfb9-414a-bddf-8c5e56b37253 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2" returned: 0 in 0.535s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a0c704e-cfb9-414a-bddf-8c5e56b37253 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:45 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8 1G Nov 05 04:02:45 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:45 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-13b80ed0-e9b3-4744-bc04-a234599b0891 tempest-ProjectReaderTests-124678288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b" returned: 0 in 0.466s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-13b80ed0-e9b3-4744-bc04-a234599b0891 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:45 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b Nov 05 04:02:45 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:45 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-13b80ed0-e9b3-4744-bc04-a234599b0891 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-8f065bc4-491a-4b7c-8041-af6cde38980b" returned: 0 in 0.306s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-13b80ed0-e9b3-4744-bc04-a234599b0891 tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-8f065bc4-491a-4b7c-8041-af6cde38980b" released by "delete_volume" :: held 0.867s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:45 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-13b80ed0-e9b3-4744-bc04-a234599b0891 tempest-ProjectReaderTests-124678288 None] Created reservations ['c279da7d-73cb-417d-a6fe-158e08c9f209', '536c2742-5fec-4b9e-8f7a-8a486751db21', '555ec93c-b9f9-44a0-9399-9009b88db250', '3758b925-44c5-4653-b60a-60913101c933'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-13b80ed0-e9b3-4744-bc04-a234599b0891 tempest-ProjectReaderTests-124678288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-13b80ed0-e9b3-4744-bc04-a234599b0891 tempest-ProjectReaderTests-124678288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:45 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-13b80ed0-e9b3-4744-bc04-a234599b0891 tempest-ProjectReaderTests-124678288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:45 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-13b80ed0-e9b3-4744-bc04-a234599b0891 tempest-ProjectReaderTests-124678288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-13b80ed0-e9b3-4744-bc04-a234599b0891 tempest-ProjectReaderTests-124678288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-13b80ed0-e9b3-4744-bc04-a234599b0891 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:45 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a0c704e-cfb9-414a-bddf-8c5e56b37253 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8 1G" returned: 0 in 0.608s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a0c704e-cfb9-414a-bddf-8c5e56b37253 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:45 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:45 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:45 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8 Nov 05 04:02:45 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:46 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-13b80ed0-e9b3-4744-bc04-a234599b0891 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.256s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:46 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-13b80ed0-e9b3-4744-bc04-a234599b0891 tempest-ProjectReaderTests-124678288 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:46 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-13b80ed0-e9b3-4744-bc04-a234599b0891 tempest-ProjectReaderTests-124678288 None] Deleted volume successfully. Nov 05 04:02:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-13b80ed0-e9b3-4744-bc04-a234599b0891 tempest-ProjectReaderTests-124678288 None] Lock "cinder-8f065bc4-491a-4b7c-8041-af6cde38980b-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:46 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a0c704e-cfb9-414a-bddf-8c5e56b37253 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8" returned: 0 in 0.329s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:46 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-8a0c704e-cfb9-414a-bddf-8c5e56b37253 tempest-ProjectMemberTests-1074212560 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8 is being set with open permissions: ugo+rw Nov 05 04:02:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a0c704e-cfb9-414a-bddf-8c5e56b37253 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:46 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8 Nov 05 04:02:46 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:46 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a0c704e-cfb9-414a-bddf-8c5e56b37253 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8" returned: 0 in 0.267s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a0c704e-cfb9-414a-bddf-8c5e56b37253 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:46 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.info Nov 05 04:02:46 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:46 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a0c704e-cfb9-414a-bddf-8c5e56b37253 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.info" returned: 0 in 0.304s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:46 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-8a0c704e-cfb9-414a-bddf-8c5e56b37253 tempest-ProjectMemberTests-1074212560 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.info is being set with open permissions: ugo+rw Nov 05 04:02:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a0c704e-cfb9-414a-bddf-8c5e56b37253 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:46 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.info Nov 05 04:02:46 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:47 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8a0c704e-cfb9-414a-bddf-8c5e56b37253 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.info" returned: 0 in 0.302s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8a0c704e-cfb9-414a-bddf-8c5e56b37253 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.524s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:47 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-8a0c704e-cfb9-414a-bddf-8c5e56b37253 tempest-ProjectMemberTests-1074212560 None] Create snapshot completed successfully Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Flow 'volume_create_manager' (af1918c9-b042-43fc-aa91-c843ea5306dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6fde46-f5cc-4674-9c45-fbd51be21ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e6fde46-f5cc-4674-9c45-fbd51be21ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-440499296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a6de18-cc7a-41ce-b8f5-9ac229cbbac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f61cc92dd46408041e858fdab3dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:48Z,use_quota=True,user_id='840642882ebf4ec4ac16689c21ed946f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23024b94-6394-423d-91ea-427f935c1f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23024b94-6394-423d-91ea-427f935c1f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13549d0-588d-417a-9cc3-41cc854dd2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13549d0-588d-417a-9cc3-41cc854dd2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64a6de18-cc7a-41ce-b8f5-9ac229cbbac7', 'volume_name': 'volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4ca515-a50d-4827-890c-af9b2ef12352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b4ca515-a50d-4827-890c-af9b2ef12352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f47505-d3bf-4353-b5aa-410e9173dfde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:47 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Volume 64a6de18-cc7a-41ce-b8f5-9ac229cbbac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7', 'volume_size': 1} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-440499296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a6de18-cc7a-41ce-b8f5-9ac229cbbac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f61cc92dd46408041e858fdab3dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:48Z,use_quota=True,user_id='840642882ebf4ec4ac16689c21ed946f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Creating volume 64a6de18-cc7a-41ce-b8f5-9ac229cbbac7 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:02:47 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] Lock "cinder-ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:47 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7 1073741824 Nov 05 04:02:47 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] Deleting offline snapshot ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8 of volume 1dbe05d3-fc31-4286-89b6-1d3dac95c8a2 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] snapshot_file for this snap is: volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7f1418-2d90-447d-a4a2-740c538a9286]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:47 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8 Nov 05 04:02:47 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:48 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7 1073741824" returned: 0 in 0.441s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:48 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8" returned: 0 in 0.383s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:02:48 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7 Nov 05 04:02:48 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:48 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[664eacbf-eda0-4772-83ce-8b8579a5e7e9]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:48 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2 Nov 05 04:02:48 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:48 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7" returned: 0 in 0.286s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:02:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63f47505-d3bf-4353-b5aa-410e9173dfde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1136315-24a6-4a4c-b9df-95d10d84391a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:48 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Volume volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7 (64a6de18-cc7a-41ce-b8f5-9ac229cbbac7): created successfully Nov 05 04:02:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1136315-24a6-4a4c-b9df-95d10d84391a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:48 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Flow 'volume_create_manager' (af1918c9-b042-43fc-aa91-c843ea5306dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:48 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-2418e62f-faad-4a3a-9aab-fc2a76b74732 tempest-ProjectReaderTests-124678288 None] Created volume successfully. Nov 05 04:02:48 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2" returned: 0 in 0.442s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:48 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8 Nov 05 04:02:48 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1bbc9b5d-fc1d-4f17-be25-7f08269ca3f4 tempest-ProjectReaderTests-124678288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1bbc9b5d-fc1d-4f17-be25-7f08269ca3f4 tempest-ProjectReaderTests-124678288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:48 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-1bbc9b5d-fc1d-4f17-be25-7f08269ca3f4 tempest-ProjectReaderTests-124678288 None] Creating offline snapshot 4fdff46a-8c94-4c09-a53f-02ec5db5a6f9 of volume 64a6de18-cc7a-41ce-b8f5-9ac229cbbac7 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:02:48 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9248922-3d88-4ec9-8c53-10c9ede5601a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1bbc9b5d-fc1d-4f17-be25-7f08269ca3f4 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:49 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7 Nov 05 04:02:49 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:49 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8" returned: 0 in 0.568s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:49 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8 Nov 05 04:02:49 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:49 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1bbc9b5d-fc1d-4f17-be25-7f08269ca3f4 tempest-ProjectReaderTests-124678288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7" returned: 0 in 0.610s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1bbc9b5d-fc1d-4f17-be25-7f08269ca3f4 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.4fdff46a-8c94-4c09-a53f-02ec5db5a6f9 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:49 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.4fdff46a-8c94-4c09-a53f-02ec5db5a6f9 1G Nov 05 04:02:49 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:49 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2.ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8" returned: 0 in 0.343s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8" released by "_delete_snapshot" :: held 1.881s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2" released by "delete_snapshot" :: held 1.910s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:49 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] Created reservations ['ede03a7c-c230-4960-98bc-1d61a44f6bef', '55092b14-148a-4ffb-9616-eda9cbe82a7d', '0796e9c1-1ff4-499c-a1c4-bbc3016ef94d', 'b007245d-ce5a-411c-8162-b6ba96257df7'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:49 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] Delete snapshot completed successfully. Nov 05 04:02:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-7a11893e-121a-4770-91c0-a6385ed4c84a tempest-ProjectMemberTests-1074212560 None] Lock "cinder-ce7d6947-577b-4e2c-8d5d-6dee3dcfccd8-delete_snapshot" released by "delete_snapshot" :: held 2.085s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f38884fd-969b-446a-9fd3-707fcf65ea77 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f38884fd-969b-446a-9fd3-707fcf65ea77 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:49 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f38884fd-969b-446a-9fd3-707fcf65ea77 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f38884fd-969b-446a-9fd3-707fcf65ea77 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2" acquired by "delete_volume" :: waited 0.022s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:50 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[128168bf-6fe7-4657-9919-e5a6dc772aa5]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f38884fd-969b-446a-9fd3-707fcf65ea77 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:50 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1bbc9b5d-fc1d-4f17-be25-7f08269ca3f4 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.4fdff46a-8c94-4c09-a53f-02ec5db5a6f9 1G" returned: 0 in 0.569s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1bbc9b5d-fc1d-4f17-be25-7f08269ca3f4 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.4fdff46a-8c94-4c09-a53f-02ec5db5a6f9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:50 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.4fdff46a-8c94-4c09-a53f-02ec5db5a6f9 Nov 05 04:02:50 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:50 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2 Nov 05 04:02:50 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:50 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1bbc9b5d-fc1d-4f17-be25-7f08269ca3f4 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.4fdff46a-8c94-4c09-a53f-02ec5db5a6f9" returned: 0 in 0.343s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:50 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-1bbc9b5d-fc1d-4f17-be25-7f08269ca3f4 tempest-ProjectReaderTests-124678288 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.4fdff46a-8c94-4c09-a53f-02ec5db5a6f9 is being set with open permissions: ugo+rw Nov 05 04:02:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1bbc9b5d-fc1d-4f17-be25-7f08269ca3f4 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.4fdff46a-8c94-4c09-a53f-02ec5db5a6f9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:50 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.4fdff46a-8c94-4c09-a53f-02ec5db5a6f9 Nov 05 04:02:50 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:50 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f38884fd-969b-446a-9fd3-707fcf65ea77 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2" returned: 0 in 0.465s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f38884fd-969b-446a-9fd3-707fcf65ea77 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:50 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2 Nov 05 04:02:50 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:50 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1bbc9b5d-fc1d-4f17-be25-7f08269ca3f4 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.4fdff46a-8c94-4c09-a53f-02ec5db5a6f9" returned: 0 in 0.338s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1bbc9b5d-fc1d-4f17-be25-7f08269ca3f4 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:50 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.info Nov 05 04:02:50 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:50 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f38884fd-969b-446a-9fd3-707fcf65ea77 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2" returned: 0 in 0.409s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f38884fd-969b-446a-9fd3-707fcf65ea77 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2" released by "delete_volume" :: held 0.958s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:51 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-f38884fd-969b-446a-9fd3-707fcf65ea77 tempest-ProjectMemberTests-1074212560 None] Created reservations ['ae90ba6a-8618-4b75-990a-0fc0769f24b8', '4f67563e-1a37-4f99-baea-e4fc8338019c', 'ea083bd6-67b0-4c36-bf58-0a911e8e67d1', '728feda0-03dc-4ecb-be42-b96e27c057ac'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f38884fd-969b-446a-9fd3-707fcf65ea77 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f38884fd-969b-446a-9fd3-707fcf65ea77 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f38884fd-969b-446a-9fd3-707fcf65ea77 tempest-ProjectMemberTests-1074212560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:51 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f38884fd-969b-446a-9fd3-707fcf65ea77 tempest-ProjectMemberTests-1074212560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f38884fd-969b-446a-9fd3-707fcf65ea77 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f38884fd-969b-446a-9fd3-707fcf65ea77 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:51 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1bbc9b5d-fc1d-4f17-be25-7f08269ca3f4 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.info" returned: 0 in 0.394s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:51 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-1bbc9b5d-fc1d-4f17-be25-7f08269ca3f4 tempest-ProjectReaderTests-124678288 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.info is being set with open permissions: ugo+rw Nov 05 04:02:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1bbc9b5d-fc1d-4f17-be25-7f08269ca3f4 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:51 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:51 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:51 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.info Nov 05 04:02:51 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:51 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1bbc9b5d-fc1d-4f17-be25-7f08269ca3f4 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.info" returned: 0 in 0.336s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-1bbc9b5d-fc1d-4f17-be25-7f08269ca3f4 tempest-ProjectReaderTests-124678288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.732s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:51 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f38884fd-969b-446a-9fd3-707fcf65ea77 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.410s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:51 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-f38884fd-969b-446a-9fd3-707fcf65ea77 tempest-ProjectMemberTests-1074212560 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:51 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f38884fd-969b-446a-9fd3-707fcf65ea77 tempest-ProjectMemberTests-1074212560 None] Deleted volume successfully. Nov 05 04:02:51 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f38884fd-969b-446a-9fd3-707fcf65ea77 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-1dbe05d3-fc31-4286-89b6-1d3dac95c8a2-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:51 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-1bbc9b5d-fc1d-4f17-be25-7f08269ca3f4 tempest-ProjectReaderTests-124678288 None] Create snapshot completed successfully Nov 05 04:02:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-4fdff46a-8c94-4c09-a53f-02ec5db5a6f9-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] Lock "cinder-4fdff46a-8c94-4c09-a53f-02ec5db5a6f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-quobyte-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-quobyte-4fdff46a-8c94-4c09-a53f-02ec5db5a6f9" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-4fdff46a-8c94-4c09-a53f-02ec5db5a6f9" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] Deleting offline snapshot 4fdff46a-8c94-4c09-a53f-02ec5db5a6f9 of volume 64a6de18-cc7a-41ce-b8f5-9ac229cbbac7 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:02:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] snapshot_file for this snap is: volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.4fdff46a-8c94-4c09-a53f-02ec5db5a6f9 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:02:52 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf44a6b0-0171-4352-9cbd-e0110181d72b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.4fdff46a-8c94-4c09-a53f-02ec5db5a6f9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:52 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.4fdff46a-8c94-4c09-a53f-02ec5db5a6f9 Nov 05 04:02:52 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:52 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.4fdff46a-8c94-4c09-a53f-02ec5db5a6f9" returned: 0 in 0.584s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:52 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:02:52 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5c9fb9-492e-4e9a-a4a6-85a06fb0a8c4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:52 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:02:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Flow 'volume_create_manager' (4094c321-8be4-468b-8e70-9ccfa39c8f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b82e72ea-34b9-4a94-84c0-718b36d4ee8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b82e72ea-34b9-4a94-84c0-718b36d4ee8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-825194044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30fd0dd7-9bab-4680-a113-bbc413b87b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3010d6d3e434042bd27e53719a4555c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:53Z,use_quota=True,user_id='7b969d6cb8a54a0fb326f742289e9663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2833542d-7e84-496f-9b26-86487563b765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2833542d-7e84-496f-9b26-86487563b765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:52 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7 Nov 05 04:02:52 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:52 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3c44c0-d411-46df-a306-5b6726f7d1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a3c44c0-d411-46df-a306-5b6726f7d1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30fd0dd7-9bab-4680-a113-bbc413b87b11', 'volume_name': 'volume-30fd0dd7-9bab-4680-a113-bbc413b87b11', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e37a5e-34c9-4eb3-aec5-c1b3d614672e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e37a5e-34c9-4eb3-aec5-c1b3d614672e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef4a6ec-c711-4410-835e-e8c024fe5d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:53 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Volume 30fd0dd7-9bab-4680-a113-bbc413b87b11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30fd0dd7-9bab-4680-a113-bbc413b87b11', 'volume_size': 1} Nov 05 04:02:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-825194044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30fd0dd7-9bab-4680-a113-bbc413b87b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3010d6d3e434042bd27e53719a4555c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:53Z,use_quota=True,user_id='7b969d6cb8a54a0fb326f742289e9663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:02:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Creating volume 30fd0dd7-9bab-4680-a113-bbc413b87b11 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:02:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:02:53 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:02:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:53 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11 1073741824 Nov 05 04:02:53 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:53 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7" returned: 0 in 0.544s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.4fdff46a-8c94-4c09-a53f-02ec5db5a6f9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:53 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.4fdff46a-8c94-4c09-a53f-02ec5db5a6f9 Nov 05 04:02:53 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:53 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11 1073741824" returned: 0 in 0.640s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:53 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11 Nov 05 04:02:53 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:53 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.4fdff46a-8c94-4c09-a53f-02ec5db5a6f9" returned: 0 in 0.546s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.4fdff46a-8c94-4c09-a53f-02ec5db5a6f9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:53 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.4fdff46a-8c94-4c09-a53f-02ec5db5a6f9 Nov 05 04:02:53 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:54 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11" returned: 0 in 0.328s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:02:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef4a6ec-c711-4410-835e-e8c024fe5d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30fd0dd7-9bab-4680-a113-bbc413b87b11', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621bed1a-a18c-45fb-9aec-d9cbf64508d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:54 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Volume volume-30fd0dd7-9bab-4680-a113-bbc413b87b11 (30fd0dd7-9bab-4680-a113-bbc413b87b11): created successfully Nov 05 04:02:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621bed1a-a18c-45fb-9aec-d9cbf64508d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Flow 'volume_create_manager' (4094c321-8be4-468b-8e70-9ccfa39c8f19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:54 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-033a6552-c1c7-4231-b88a-a1b6de20d49b tempest-ProjectMemberTests-1074212560 None] Created volume successfully. Nov 05 04:02:54 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7.4fdff46a-8c94-4c09-a53f-02ec5db5a6f9" returned: 0 in 0.352s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-4fdff46a-8c94-4c09-a53f-02ec5db5a6f9" released by "_delete_snapshot" :: held 2.176s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7" released by "delete_snapshot" :: held 2.212s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:54 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] Created reservations ['6bfb1f8e-49a5-4fac-a91d-2a304f1a6809', '9cba85aa-c904-4259-b1ef-58414d36d68d', '9b70f7c6-16f5-4ae4-adc5-e9642bf030f9', '858ea663-56b9-4427-a123-0076a33893a8'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:54 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] Delete snapshot completed successfully. Nov 05 04:02:54 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-9b4f6ddb-562c-476c-ae08-854f06c6c230 tempest-ProjectReaderTests-124678288 None] Lock "cinder-4fdff46a-8c94-4c09-a53f-02ec5db5a6f9-delete_snapshot" released by "delete_snapshot" :: held 2.427s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9dfcefda-f631-4f00-b0f9-abb9fb0f1c06 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9dfcefda-f631-4f00-b0f9-abb9fb0f1c06 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-9dfcefda-f631-4f00-b0f9-abb9fb0f1c06 tempest-ProjectMemberTests-1074212560 None] Creating offline snapshot 87fc0d25-9a37-492d-9025-1a227e638d03 of volume 30fd0dd7-9bab-4680-a113-bbc413b87b11 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:02:55 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[017db5e1-63ae-438c-b5e1-f46f05b711d7]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9dfcefda-f631-4f00-b0f9-abb9fb0f1c06 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-47ce6672-369d-41a4-a9db-bf1a856b9724 tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-47ce6672-369d-41a4-a9db-bf1a856b9724 tempest-ProjectReaderTests-124678288 None] Lock "cinder-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-47ce6672-369d-41a4-a9db-bf1a856b9724 tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-quobyte-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:55 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-47ce6672-369d-41a4-a9db-bf1a856b9724 tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7" acquired by "delete_volume" :: waited 0.033s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:55 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11 Nov 05 04:02:55 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:55 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42556f7-4692-48ce-812b-84424234bd7d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-47ce6672-369d-41a4-a9db-bf1a856b9724 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:55 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7 Nov 05 04:02:55 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:55 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9dfcefda-f631-4f00-b0f9-abb9fb0f1c06 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11" returned: 0 in 0.561s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9dfcefda-f631-4f00-b0f9-abb9fb0f1c06 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.87fc0d25-9a37-492d-9025-1a227e638d03 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:55 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.87fc0d25-9a37-492d-9025-1a227e638d03 1G Nov 05 04:02:55 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:56 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-47ce6672-369d-41a4-a9db-bf1a856b9724 tempest-ProjectReaderTests-124678288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7" returned: 0 in 0.436s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-47ce6672-369d-41a4-a9db-bf1a856b9724 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:56 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7 Nov 05 04:02:56 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:56 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-47ce6672-369d-41a4-a9db-bf1a856b9724 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7" returned: 0 in 0.369s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-47ce6672-369d-41a4-a9db-bf1a856b9724 tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7" released by "delete_volume" :: held 0.916s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:56 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9dfcefda-f631-4f00-b0f9-abb9fb0f1c06 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.87fc0d25-9a37-492d-9025-1a227e638d03 1G" returned: 0 in 0.572s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9dfcefda-f631-4f00-b0f9-abb9fb0f1c06 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30fd0dd7-9bab-4680-a113-bbc413b87b11 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.87fc0d25-9a37-492d-9025-1a227e638d03 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:56 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30fd0dd7-9bab-4680-a113-bbc413b87b11 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.87fc0d25-9a37-492d-9025-1a227e638d03 Nov 05 04:02:56 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-47ce6672-369d-41a4-a9db-bf1a856b9724 tempest-ProjectReaderTests-124678288 None] Created reservations ['43ab790d-57ba-4910-83e5-3c08452c29a5', '34583bf4-f126-4e33-9efc-2e0e4a985880', '08404301-ba49-4af5-bd9f-50e8d40580fb', 'fb047ae9-f476-4b2e-9f06-1d212fae873d'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Flow 'volume_create_manager' (4e2b3e29-ea6a-412b-8a2d-50befe480456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8fbe82-799d-4acc-b3bd-915fec74abcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df8fbe82-799d-4acc-b3bd-915fec74abcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1547682951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd17eda-0fb4-4d4d-ad2b-8862a518ca27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ad2921638f49bd93f538f66d06a5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:57Z,use_quota=True,user_id='4ea668f85dd04ba0bdc358783b1314c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f259ffa-f94c-46b4-b13d-dad3a145f94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f259ffa-f94c-46b4-b13d-dad3a145f94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20b34b3-784d-4bec-8905-db1d59b5d40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20b34b3-784d-4bec-8905-db1d59b5d40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd17eda-0fb4-4d4d-ad2b-8862a518ca27', 'volume_name': 'volume-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29130272-9907-4db4-8ca6-4ccadbb3115b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29130272-9907-4db4-8ca6-4ccadbb3115b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8bc960-91b7-41bb-8658-ed31a8f39d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:56 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Volume ddd17eda-0fb4-4d4d-ad2b-8862a518ca27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27', 'volume_size': 1} Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-47ce6672-369d-41a4-a9db-bf1a856b9724 tempest-ProjectReaderTests-124678288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-47ce6672-369d-41a4-a9db-bf1a856b9724 tempest-ProjectReaderTests-124678288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-47ce6672-369d-41a4-a9db-bf1a856b9724 tempest-ProjectReaderTests-124678288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-47ce6672-369d-41a4-a9db-bf1a856b9724 tempest-ProjectReaderTests-124678288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-47ce6672-369d-41a4-a9db-bf1a856b9724 tempest-ProjectReaderTests-124678288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-47ce6672-369d-41a4-a9db-bf1a856b9724 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:56 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:56 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:56 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9dfcefda-f631-4f00-b0f9-abb9fb0f1c06 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30fd0dd7-9bab-4680-a113-bbc413b87b11 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.87fc0d25-9a37-492d-9025-1a227e638d03" returned: 0 in 0.417s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:56 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-9dfcefda-f631-4f00-b0f9-abb9fb0f1c06 tempest-ProjectMemberTests-1074212560 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.87fc0d25-9a37-492d-9025-1a227e638d03 is being set with open permissions: ugo+rw Nov 05 04:02:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9dfcefda-f631-4f00-b0f9-abb9fb0f1c06 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.87fc0d25-9a37-492d-9025-1a227e638d03 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:56 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.87fc0d25-9a37-492d-9025-1a227e638d03 Nov 05 04:02:56 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:57 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-47ce6672-369d-41a4-a9db-bf1a856b9724 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.329s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-47ce6672-369d-41a4-a9db-bf1a856b9724 tempest-ProjectReaderTests-124678288 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:57 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-47ce6672-369d-41a4-a9db-bf1a856b9724 tempest-ProjectReaderTests-124678288 None] Deleted volume successfully. Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-47ce6672-369d-41a4-a9db-bf1a856b9724 tempest-ProjectReaderTests-124678288 None] Lock "cinder-64a6de18-cc7a-41ce-b8f5-9ac229cbbac7-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:02:57 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9dfcefda-f631-4f00-b0f9-abb9fb0f1c06 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.87fc0d25-9a37-492d-9025-1a227e638d03" returned: 0 in 0.320s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9dfcefda-f631-4f00-b0f9-abb9fb0f1c06 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:02:57 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.info Nov 05 04:02:57 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Flow 'volume_create_manager' (52b05833-b447-4539-8e60-c87d81cc0060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (733161d5-7791-44f0-8d04-e61c31fe096e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (733161d5-7791-44f0-8d04-e61c31fe096e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1776013367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6efc4e-1f52-4d44-b629-583af644b9b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f61cc92dd46408041e858fdab3dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:57Z,use_quota=True,user_id='840642882ebf4ec4ac16689c21ed946f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4de007d-571d-408d-a92b-2a9ff29d4318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4de007d-571d-408d-a92b-2a9ff29d4318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2257ad3a-7085-47bd-883c-36ba5c133daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2257ad3a-7085-47bd-883c-36ba5c133daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc6efc4e-1f52-4d44-b629-583af644b9b0', 'volume_name': 'volume-bc6efc4e-1f52-4d44-b629-583af644b9b0', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd37f2cf-bfcb-4298-9ad1-9845c11074a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd37f2cf-bfcb-4298-9ad1-9845c11074a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (935c5e0b-0459-49ee-89e8-104d7b43a286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:57 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Volume bc6efc4e-1f52-4d44-b629-583af644b9b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc6efc4e-1f52-4d44-b629-583af644b9b0', 'volume_size': 1} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:57 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9dfcefda-f631-4f00-b0f9-abb9fb0f1c06 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.info" returned: 0 in 0.309s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:57 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-9dfcefda-f631-4f00-b0f9-abb9fb0f1c06 tempest-ProjectMemberTests-1074212560 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.info is being set with open permissions: ugo+rw Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9dfcefda-f631-4f00-b0f9-abb9fb0f1c06 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:57 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.info Nov 05 04:02:57 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:57 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9dfcefda-f631-4f00-b0f9-abb9fb0f1c06 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.info" returned: 0 in 0.245s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9dfcefda-f631-4f00-b0f9-abb9fb0f1c06 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.545s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.073s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1547682951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd17eda-0fb4-4d4d-ad2b-8862a518ca27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ad2921638f49bd93f538f66d06a5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:57Z,use_quota=True,user_id='4ea668f85dd04ba0bdc358783b1314c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Creating volume ddd17eda-0fb4-4d4d-ad2b-8862a518ca27 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:02:57 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:02:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:57 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27 1073741824 Nov 05 04:02:57 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:57 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-9dfcefda-f631-4f00-b0f9-abb9fb0f1c06 tempest-ProjectMemberTests-1074212560 None] Create snapshot completed successfully Nov 05 04:02:58 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27 1073741824" returned: 0 in 0.468s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:58 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27 Nov 05 04:02:58 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-87fc0d25-9a37-492d-9025-1a227e638d03-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-87fc0d25-9a37-492d-9025-1a227e638d03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-30fd0dd7-9bab-4680-a113-bbc413b87b11" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-30fd0dd7-9bab-4680-a113-bbc413b87b11" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-87fc0d25-9a37-492d-9025-1a227e638d03" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-87fc0d25-9a37-492d-9025-1a227e638d03" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] Deleting offline snapshot 87fc0d25-9a37-492d-9025-1a227e638d03 of volume 30fd0dd7-9bab-4680-a113-bbc413b87b11 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] snapshot_file for this snap is: volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.87fc0d25-9a37-492d-9025-1a227e638d03 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efd05f3-4d0c-40d1-913d-281e4564b43b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.87fc0d25-9a37-492d-9025-1a227e638d03 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:58 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:02:58 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:58 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27" returned: 0 in 0.333s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:58 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.87fc0d25-9a37-492d-9025-1a227e638d03 Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:02:58 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.326s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1776013367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6efc4e-1f52-4d44-b629-583af644b9b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f61cc92dd46408041e858fdab3dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:02:57Z,use_quota=True,user_id='840642882ebf4ec4ac16689c21ed946f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Creating volume bc6efc4e-1f52-4d44-b629-583af644b9b0 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:02:58 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:58 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0 1073741824 Nov 05 04:02:58 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8bc960-91b7-41bb-8658-ed31a8f39d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191502ec-07f2-4994-9d94-2891354efbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:58 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Volume volume-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27 (ddd17eda-0fb4-4d4d-ad2b-8862a518ca27): created successfully Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191502ec-07f2-4994-9d94-2891354efbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Flow 'volume_create_manager' (4e2b3e29-ea6a-412b-8a2d-50befe480456) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:58 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f3eb7652-1328-4833-83ba-ab49e2438d2e tempest-ProjectReaderTests-2118183461 None] Created volume successfully. Nov 05 04:02:58 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.328s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 28 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 04:02:58 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.87fc0d25-9a37-492d-9025-1a227e638d03" returned: 0 in 0.458s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30fd0dd7-9bab-4680-a113-bbc413b87b11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:02:59 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b3c217-01eb-4aab-a50f-dcd73292716c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:02:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:59 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11 Nov 05 04:02:59 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:59 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0 1073741824" returned: 0 in 0.613s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:59 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0 Nov 05 04:02:59 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:59 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11" returned: 0 in 0.510s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.87fc0d25-9a37-492d-9025-1a227e638d03 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:02:59 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.87fc0d25-9a37-492d-9025-1a227e638d03 Nov 05 04:02:59 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:02:59 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0" returned: 0 in 0.357s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:59 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:02:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:02:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (935c5e0b-0459-49ee-89e8-104d7b43a286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc6efc4e-1f52-4d44-b629-583af644b9b0', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8982adab-3cc9-41d0-aa3e-320becaadfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:02:59 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Volume volume-bc6efc4e-1f52-4d44-b629-583af644b9b0 (bc6efc4e-1f52-4d44-b629-583af644b9b0): created successfully Nov 05 04:02:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8982adab-3cc9-41d0-aa3e-320becaadfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:02:59 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Flow 'volume_create_manager' (52b05833-b447-4539-8e60-c87d81cc0060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:02:59 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-2a414c78-640e-46fd-ba78-84e48fea4275 tempest-ProjectReaderTests-124678288 None] Created volume successfully. Nov 05 04:02:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6401f28e-0618-4e14-acd6-d63d960369e4 tempest-ProjectReaderTests-2118183461 None] Acquiring lock "cinder-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:02:59 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Nov 05 04:02:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6401f28e-0618-4e14-acd6-d63d960369e4 tempest-ProjectReaderTests-2118183461 None] Lock "cinder-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:02:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.87fc0d25-9a37-492d-9025-1a227e638d03" returned: 0 in 0.464s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:02:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.87fc0d25-9a37-492d-9025-1a227e638d03 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:00 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.87fc0d25-9a37-492d-9025-1a227e638d03 Nov 05 04:03:00 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6401f28e-0618-4e14-acd6-d63d960369e4 tempest-ProjectReaderTests-2118183461 None] Acquiring lock "cinder-quobyte-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6401f28e-0618-4e14-acd6-d63d960369e4 tempest-ProjectReaderTests-2118183461 None] Lock "cinder-quobyte-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27" acquired by "delete_volume" :: waited 0.018s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:00 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a2c1cc-e84b-4b86-b9bc-0bd6ae1eb90f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6401f28e-0618-4e14-acd6-d63d960369e4 tempest-ProjectReaderTests-2118183461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:00 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27 Nov 05 04:03:00 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:00 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11.87fc0d25-9a37-492d-9025-1a227e638d03" returned: 0 in 0.327s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-87fc0d25-9a37-492d-9025-1a227e638d03" released by "_delete_snapshot" :: held 1.900s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-30fd0dd7-9bab-4680-a113-bbc413b87b11" released by "delete_snapshot" :: held 1.930s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:00 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] Created reservations ['098a9cbc-c931-420f-aa49-4a2bda79b6d4', 'c02fbf68-26dd-4faa-8da8-18fe106ba11f', '20d5cd09-7957-4356-adad-b5b0729409b7', 'b968bb53-de45-4f0f-b9cc-6f8a3f803ae7'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:00 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] Delete snapshot completed successfully. Nov 05 04:03:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-0197a673-104f-49d7-b558-391669780bb9 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-87fc0d25-9a37-492d-9025-1a227e638d03-delete_snapshot" released by "delete_snapshot" :: held 2.198s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:00 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6401f28e-0618-4e14-acd6-d63d960369e4 tempest-ProjectReaderTests-2118183461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27" returned: 0 in 0.518s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6401f28e-0618-4e14-acd6-d63d960369e4 tempest-ProjectReaderTests-2118183461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:00 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27 Nov 05 04:03:00 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d614d741-4250-4cb1-8948-741c7f184ad2 tempest-ProjectReaderTests-124678288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d614d741-4250-4cb1-8948-741c7f184ad2 tempest-ProjectReaderTests-124678288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-d614d741-4250-4cb1-8948-741c7f184ad2 tempest-ProjectReaderTests-124678288 None] Creating offline snapshot bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc of volume bc6efc4e-1f52-4d44-b629-583af644b9b0 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:03:00 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[908d16fd-e7d9-4e79-a269-91177bbe46f2]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d614d741-4250-4cb1-8948-741c7f184ad2 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:00 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0 Nov 05 04:03:00 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:00 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6401f28e-0618-4e14-acd6-d63d960369e4 tempest-ProjectReaderTests-2118183461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27" returned: 0 in 0.293s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6401f28e-0618-4e14-acd6-d63d960369e4 tempest-ProjectReaderTests-2118183461 None] Lock "cinder-quobyte-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27" released by "delete_volume" :: held 0.875s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-6401f28e-0618-4e14-acd6-d63d960369e4 tempest-ProjectReaderTests-2118183461 None] Created reservations ['a880fa9e-468e-46a7-ac59-078341249063', '1fa600c7-b450-4e61-8f69-374d442f7fea', 'fe9a8744-2098-433d-8648-bfff8122bc33', '9a027b1e-f34a-4b11-935c-c0d26cdb58a9'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6401f28e-0618-4e14-acd6-d63d960369e4 tempest-ProjectReaderTests-2118183461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6401f28e-0618-4e14-acd6-d63d960369e4 tempest-ProjectReaderTests-2118183461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6401f28e-0618-4e14-acd6-d63d960369e4 tempest-ProjectReaderTests-2118183461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6401f28e-0618-4e14-acd6-d63d960369e4 tempest-ProjectReaderTests-2118183461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6401f28e-0618-4e14-acd6-d63d960369e4 tempest-ProjectReaderTests-2118183461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6401f28e-0618-4e14-acd6-d63d960369e4 tempest-ProjectReaderTests-2118183461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:01 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:03:01 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:01 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d614d741-4250-4cb1-8948-741c7f184ad2 tempest-ProjectReaderTests-124678288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0" returned: 0 in 0.440s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d614d741-4250-4cb1-8948-741c7f184ad2 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:01 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc 1G Nov 05 04:03:01 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:01 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6401f28e-0618-4e14-acd6-d63d960369e4 tempest-ProjectReaderTests-2118183461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.362s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-6401f28e-0618-4e14-acd6-d63d960369e4 tempest-ProjectReaderTests-2118183461 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:03:01 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-6401f28e-0618-4e14-acd6-d63d960369e4 tempest-ProjectReaderTests-2118183461 None] Deleted volume successfully. Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6401f28e-0618-4e14-acd6-d63d960369e4 tempest-ProjectReaderTests-2118183461 None] Lock "cinder-ddd17eda-0fb4-4d4d-ad2b-8862a518ca27-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-59b07c0b-768f-4cb0-9c45-392d62c6050c tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-30fd0dd7-9bab-4680-a113-bbc413b87b11-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-59b07c0b-768f-4cb0-9c45-392d62c6050c tempest-ProjectMemberTests-1074212560 None] Lock "cinder-30fd0dd7-9bab-4680-a113-bbc413b87b11-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:01 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d614d741-4250-4cb1-8948-741c7f184ad2 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc 1G" returned: 0 in 0.668s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d614d741-4250-4cb1-8948-741c7f184ad2 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc6efc4e-1f52-4d44-b629-583af644b9b0 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:01 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc6efc4e-1f52-4d44-b629-583af644b9b0 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc Nov 05 04:03:01 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Flow 'volume_create_manager' (655e1b56-b158-4e31-b769-2bb440199ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab188a6-0fa9-4a53-aff3-df8fc7e5803b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-59b07c0b-768f-4cb0-9c45-392d62c6050c tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-30fd0dd7-9bab-4680-a113-bbc413b87b11" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab188a6-0fa9-4a53-aff3-df8fc7e5803b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1046501673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c76107-3b35-4a54-a743-677594e150ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ad2921638f49bd93f538f66d06a5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:02Z,use_quota=True,user_id='4ea668f85dd04ba0bdc358783b1314c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce8a7cb-e2be-4198-bd9d-dbe1c52d8eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce8a7cb-e2be-4198-bd9d-dbe1c52d8eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb9da24-88fc-4a7c-87bf-86638f88b1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb9da24-88fc-4a7c-87bf-86638f88b1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0c76107-3b35-4a54-a743-677594e150ac', 'volume_name': 'volume-e0c76107-3b35-4a54-a743-677594e150ac', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be0da7b-b626-4ee4-8769-dd259545476a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be0da7b-b626-4ee4-8769-dd259545476a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40771be4-aa3c-46ea-baeb-2b494596cf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:01 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Volume e0c76107-3b35-4a54-a743-677594e150ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0c76107-3b35-4a54-a743-677594e150ac', 'volume_size': 1} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:01 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-59b07c0b-768f-4cb0-9c45-392d62c6050c tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-30fd0dd7-9bab-4680-a113-bbc413b87b11" acquired by "delete_volume" :: waited 0.060s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:02 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[9680cba1-51df-4bc6-ae2b-b16784175d49]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-59b07c0b-768f-4cb0-9c45-392d62c6050c tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:02 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11 Nov 05 04:03:02 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:02 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d614d741-4250-4cb1-8948-741c7f184ad2 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc6efc4e-1f52-4d44-b629-583af644b9b0 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc" returned: 0 in 0.356s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:02 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-d614d741-4250-4cb1-8948-741c7f184ad2 tempest-ProjectReaderTests-124678288 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc is being set with open permissions: ugo+rw Nov 05 04:03:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d614d741-4250-4cb1-8948-741c7f184ad2 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:02 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc Nov 05 04:03:02 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:02 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-59b07c0b-768f-4cb0-9c45-392d62c6050c tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11" returned: 0 in 0.398s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-59b07c0b-768f-4cb0-9c45-392d62c6050c tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:02 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11 Nov 05 04:03:02 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:02 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d614d741-4250-4cb1-8948-741c7f184ad2 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc" returned: 0 in 0.282s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d614d741-4250-4cb1-8948-741c7f184ad2 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:02 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.info Nov 05 04:03:02 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:02 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-59b07c0b-768f-4cb0-9c45-392d62c6050c tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-30fd0dd7-9bab-4680-a113-bbc413b87b11" returned: 0 in 0.289s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:02 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-59b07c0b-768f-4cb0-9c45-392d62c6050c tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-30fd0dd7-9bab-4680-a113-bbc413b87b11" released by "delete_volume" :: held 0.767s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:02 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-59b07c0b-768f-4cb0-9c45-392d62c6050c tempest-ProjectMemberTests-1074212560 None] Created reservations ['7342d9ba-9731-4dcc-9687-1328cff485c6', '077360ee-3a30-49a8-ae95-126c8c34ecc7', 'e28d1dba-d01c-44cc-a0f7-d3e66adfeeca', '487457a6-1623-41f7-905b-49e4a30c6da2'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:02 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d614d741-4250-4cb1-8948-741c7f184ad2 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.info" returned: 0 in 0.322s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:02 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-d614d741-4250-4cb1-8948-741c7f184ad2 tempest-ProjectReaderTests-124678288 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.info is being set with open permissions: ugo+rw Nov 05 04:03:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d614d741-4250-4cb1-8948-741c7f184ad2 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:02 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.info Nov 05 04:03:02 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-59b07c0b-768f-4cb0-9c45-392d62c6050c tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-59b07c0b-768f-4cb0-9c45-392d62c6050c tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:02 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-59b07c0b-768f-4cb0-9c45-392d62c6050c tempest-ProjectMemberTests-1074212560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:02 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-59b07c0b-768f-4cb0-9c45-392d62c6050c tempest-ProjectMemberTests-1074212560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-59b07c0b-768f-4cb0-9c45-392d62c6050c tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:02 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-59b07c0b-768f-4cb0-9c45-392d62c6050c tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:02 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:03:02 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:03 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d614d741-4250-4cb1-8948-741c7f184ad2 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.info" returned: 0 in 0.261s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d614d741-4250-4cb1-8948-741c7f184ad2 tempest-ProjectReaderTests-124678288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.431s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.144s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1046501673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0c76107-3b35-4a54-a743-677594e150ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ad2921638f49bd93f538f66d06a5d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:02Z,use_quota=True,user_id='4ea668f85dd04ba0bdc358783b1314c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Creating volume e0c76107-3b35-4a54-a743-677594e150ac {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:03:03 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0c76107-3b35-4a54-a743-677594e150ac 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:03 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0c76107-3b35-4a54-a743-677594e150ac 1073741824 Nov 05 04:03:03 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:03 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-d614d741-4250-4cb1-8948-741c7f184ad2 tempest-ProjectReaderTests-124678288 None] Create snapshot completed successfully Nov 05 04:03:03 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-59b07c0b-768f-4cb0-9c45-392d62c6050c tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.273s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-59b07c0b-768f-4cb0-9c45-392d62c6050c tempest-ProjectMemberTests-1074212560 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:03:03 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-59b07c0b-768f-4cb0-9c45-392d62c6050c tempest-ProjectMemberTests-1074212560 None] Deleted volume successfully. Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-59b07c0b-768f-4cb0-9c45-392d62c6050c tempest-ProjectMemberTests-1074212560 None] Lock "cinder-30fd0dd7-9bab-4680-a113-bbc413b87b11-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:03 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0c76107-3b35-4a54-a743-677594e150ac 1073741824" returned: 0 in 0.485s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0c76107-3b35-4a54-a743-677594e150ac {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:03 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0c76107-3b35-4a54-a743-677594e150ac Nov 05 04:03:03 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] Lock "cinder-bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-quobyte-bc6efc4e-1f52-4d44-b629-583af644b9b0" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-bc6efc4e-1f52-4d44-b629-583af644b9b0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-quobyte-bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:03 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0c76107-3b35-4a54-a743-677594e150ac" returned: 0 in 0.306s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40771be4-aa3c-46ea-baeb-2b494596cf0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0c76107-3b35-4a54-a743-677594e150ac', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e2bb7d-da2e-47f8-a09b-014816037f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:03 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] Deleting offline snapshot bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc of volume bc6efc4e-1f52-4d44-b629-583af644b9b0 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] snapshot_file for this snap is: volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:03:04 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Volume volume-e0c76107-3b35-4a54-a743-677594e150ac (e0c76107-3b35-4a54-a743-677594e150ac): created successfully Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e2bb7d-da2e-47f8-a09b-014816037f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Flow 'volume_create_manager' (655e1b56-b158-4e31-b769-2bb440199ff4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafb2510-7f1e-4677-bd77-6730f287327e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:04 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-12ca5587-5498-49e3-8f76-bf108357794d tempest-ProjectReaderTests-2118183461 None] Created volume successfully. Nov 05 04:03:04 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc Nov 05 04:03:04 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:04 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc" returned: 0 in 0.478s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc6efc4e-1f52-4d44-b629-583af644b9b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9da1414-7d16-4e9b-a18b-c88084bd82db]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Flow 'volume_create_manager' (ad485ae5-519f-4a30-8fbb-451f6d7c21b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3f931a-a92e-49bc-bfc2-6c1cce48649a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3f931a-a92e-49bc-bfc2-6c1cce48649a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1559053244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e718e9c-bb69-482c-935a-9b009de71c4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3010d6d3e434042bd27e53719a4555c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:05Z,use_quota=True,user_id='7b969d6cb8a54a0fb326f742289e9663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c92dc06-0015-4520-b3aa-b8d1ae20aabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c92dc06-0015-4520-b3aa-b8d1ae20aabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4edfd8-6e9f-4a79-a847-ec58bf173bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb4edfd8-6e9f-4a79-a847-ec58bf173bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e718e9c-bb69-482c-935a-9b009de71c4d', 'volume_name': 'volume-7e718e9c-bb69-482c-935a-9b009de71c4d', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a30f7b9-eb8e-41b3-91eb-6d841105a2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a30f7b9-eb8e-41b3-91eb-6d841105a2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:04 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0 Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9961dc-a414-49be-a946-8934de1c51ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:04 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Volume 7e718e9c-bb69-482c-935a-9b009de71c4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e718e9c-bb69-482c-935a-9b009de71c4d', 'volume_size': 1} Nov 05 04:03:04 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1559053244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e718e9c-bb69-482c-935a-9b009de71c4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3010d6d3e434042bd27e53719a4555c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:05Z,use_quota=True,user_id='7b969d6cb8a54a0fb326f742289e9663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Creating volume 7e718e9c-bb69-482c-935a-9b009de71c4d {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:03:04 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:03:04 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:04 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d 1073741824 Nov 05 04:03:04 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-794e5d17-0926-4bfd-a418-db8cf2b0552c tempest-ProjectReaderTests-2118183461 None] Acquiring lock "cinder-e0c76107-3b35-4a54-a743-677594e150ac-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:05 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0" returned: 0 in 0.438s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-794e5d17-0926-4bfd-a418-db8cf2b0552c tempest-ProjectReaderTests-2118183461 None] Lock "cinder-e0c76107-3b35-4a54-a743-677594e150ac-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:05 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc Nov 05 04:03:05 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-794e5d17-0926-4bfd-a418-db8cf2b0552c tempest-ProjectReaderTests-2118183461 None] Acquiring lock "cinder-quobyte-e0c76107-3b35-4a54-a743-677594e150ac" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-794e5d17-0926-4bfd-a418-db8cf2b0552c tempest-ProjectReaderTests-2118183461 None] Lock "cinder-quobyte-e0c76107-3b35-4a54-a743-677594e150ac" acquired by "delete_volume" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47a513e-2415-4a95-80d5-2aab93cb087a]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-794e5d17-0926-4bfd-a418-db8cf2b0552c tempest-ProjectReaderTests-2118183461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0c76107-3b35-4a54-a743-677594e150ac {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:05 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d 1073741824" returned: 0 in 0.554s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:05 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0c76107-3b35-4a54-a743-677594e150ac Nov 05 04:03:05 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:05 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d Nov 05 04:03:05 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:05 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc" returned: 0 in 0.499s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:05 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc Nov 05 04:03:05 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:05 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d" returned: 0 in 0.319s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9961dc-a414-49be-a946-8934de1c51ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e718e9c-bb69-482c-935a-9b009de71c4d', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92141fbd-3183-4c0b-90a0-67e66c028e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:05 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Volume volume-7e718e9c-bb69-482c-935a-9b009de71c4d (7e718e9c-bb69-482c-935a-9b009de71c4d): created successfully Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92141fbd-3183-4c0b-90a0-67e66c028e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Flow 'volume_create_manager' (ad485ae5-519f-4a30-8fbb-451f6d7c21b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:05 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:05 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f55a9d55-68bc-424c-ad6e-d4930f26f57d tempest-ProjectMemberTests-1074212560 None] Created volume successfully. Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-794e5d17-0926-4bfd-a418-db8cf2b0552c tempest-ProjectReaderTests-2118183461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0c76107-3b35-4a54-a743-677594e150ac" returned: 0 in 0.518s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-794e5d17-0926-4bfd-a418-db8cf2b0552c tempest-ProjectReaderTests-2118183461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0c76107-3b35-4a54-a743-677594e150ac {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:05 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0c76107-3b35-4a54-a743-677594e150ac Nov 05 04:03:05 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:05 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0.bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc" returned: 0 in 0.311s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc" released by "_delete_snapshot" :: held 1.898s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-bc6efc4e-1f52-4d44-b629-583af644b9b0" released by "delete_snapshot" :: held 1.952s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:05 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] Created reservations ['4af17431-6103-4f09-8100-8699800bd2f7', '7828e10a-d485-4e15-a79d-ec8bb8ae552d', 'bb476c8b-561b-43ee-a5b1-d8d0d88ec954', '868a92d5-8112-4c8a-810d-0aeb96f8a5b1'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:06 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] Delete snapshot completed successfully. Nov 05 04:03:06 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-1a56b0ca-2968-4426-8fb2-a6cbb664ad1b tempest-ProjectReaderTests-124678288 None] Lock "cinder-bcdfce0e-bb12-46d0-9a3a-0b2b6464c2bc-delete_snapshot" released by "delete_snapshot" :: held 2.121s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-794e5d17-0926-4bfd-a418-db8cf2b0552c tempest-ProjectReaderTests-2118183461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-e0c76107-3b35-4a54-a743-677594e150ac" returned: 0 in 0.304s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-794e5d17-0926-4bfd-a418-db8cf2b0552c tempest-ProjectReaderTests-2118183461 None] Lock "cinder-quobyte-e0c76107-3b35-4a54-a743-677594e150ac" released by "delete_volume" :: held 0.870s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:06 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-794e5d17-0926-4bfd-a418-db8cf2b0552c tempest-ProjectReaderTests-2118183461 None] Created reservations ['171f71a8-ec5a-4283-b9df-24d96dd458f7', 'a5f2c56c-9afc-401e-8763-ea2bad2dc8d2', '151733f3-45d6-45d1-8bdf-7a99dcaf8d91', '85d4b4fb-afe8-4830-94fa-dec51c49b137'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-794e5d17-0926-4bfd-a418-db8cf2b0552c tempest-ProjectReaderTests-2118183461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-794e5d17-0926-4bfd-a418-db8cf2b0552c tempest-ProjectReaderTests-2118183461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-794e5d17-0926-4bfd-a418-db8cf2b0552c tempest-ProjectReaderTests-2118183461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-794e5d17-0926-4bfd-a418-db8cf2b0552c tempest-ProjectReaderTests-2118183461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-794e5d17-0926-4bfd-a418-db8cf2b0552c tempest-ProjectReaderTests-2118183461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-794e5d17-0926-4bfd-a418-db8cf2b0552c tempest-ProjectReaderTests-2118183461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:06 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:03:06 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:06 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-794e5d17-0926-4bfd-a418-db8cf2b0552c tempest-ProjectReaderTests-2118183461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.279s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:06 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-794e5d17-0926-4bfd-a418-db8cf2b0552c tempest-ProjectReaderTests-2118183461 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:03:06 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-794e5d17-0926-4bfd-a418-db8cf2b0552c tempest-ProjectReaderTests-2118183461 None] Deleted volume successfully. Nov 05 04:03:06 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-794e5d17-0926-4bfd-a418-db8cf2b0552c tempest-ProjectReaderTests-2118183461 None] Lock "cinder-e0c76107-3b35-4a54-a743-677594e150ac-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-721cf3f0-9645-4bd0-bf4a-e61c3f85786a tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-721cf3f0-9645-4bd0-bf4a-e61c3f85786a tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:06 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-721cf3f0-9645-4bd0-bf4a-e61c3f85786a tempest-ProjectMemberTests-1074212560 None] Creating offline snapshot 36f2a6a0-ee85-44b9-9581-94860c9d603d of volume 7e718e9c-bb69-482c-935a-9b009de71c4d {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:03:06 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed387a4-b747-4036-82fe-ef4c16b4976f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:06 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-721cf3f0-9645-4bd0-bf4a-e61c3f85786a tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:07 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d Nov 05 04:03:07 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:07 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d7b43d91-9ad2-40ee-9158-606467bc3623 tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-bc6efc4e-1f52-4d44-b629-583af644b9b0-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:07 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d7b43d91-9ad2-40ee-9158-606467bc3623 tempest-ProjectReaderTests-124678288 None] Lock "cinder-bc6efc4e-1f52-4d44-b629-583af644b9b0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:07 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d7b43d91-9ad2-40ee-9158-606467bc3623 tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-quobyte-bc6efc4e-1f52-4d44-b629-583af644b9b0" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:07 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d7b43d91-9ad2-40ee-9158-606467bc3623 tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-bc6efc4e-1f52-4d44-b629-583af644b9b0" acquired by "delete_volume" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:07 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24ed5ea-f41f-486b-815c-94c72645416f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d7b43d91-9ad2-40ee-9158-606467bc3623 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:07 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-721cf3f0-9645-4bd0-bf4a-e61c3f85786a tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d" returned: 0 in 0.526s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-721cf3f0-9645-4bd0-bf4a-e61c3f85786a tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.36f2a6a0-ee85-44b9-9581-94860c9d603d 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:07 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0 Nov 05 04:03:07 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:07 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.36f2a6a0-ee85-44b9-9581-94860c9d603d 1G Nov 05 04:03:07 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:07 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d7b43d91-9ad2-40ee-9158-606467bc3623 tempest-ProjectReaderTests-124678288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0" returned: 0 in 0.517s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:07 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d7b43d91-9ad2-40ee-9158-606467bc3623 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:07 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0 Nov 05 04:03:07 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:08 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-721cf3f0-9645-4bd0-bf4a-e61c3f85786a tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.36f2a6a0-ee85-44b9-9581-94860c9d603d 1G" returned: 0 in 0.602s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-721cf3f0-9645-4bd0-bf4a-e61c3f85786a tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e718e9c-bb69-482c-935a-9b009de71c4d -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.36f2a6a0-ee85-44b9-9581-94860c9d603d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:08 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e718e9c-bb69-482c-935a-9b009de71c4d -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.36f2a6a0-ee85-44b9-9581-94860c9d603d Nov 05 04:03:08 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:08 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d7b43d91-9ad2-40ee-9158-606467bc3623 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-bc6efc4e-1f52-4d44-b629-583af644b9b0" returned: 0 in 0.285s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d7b43d91-9ad2-40ee-9158-606467bc3623 tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-bc6efc4e-1f52-4d44-b629-583af644b9b0" released by "delete_volume" :: held 0.906s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:08 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-d7b43d91-9ad2-40ee-9158-606467bc3623 tempest-ProjectReaderTests-124678288 None] Created reservations ['85202546-a353-4da3-ab03-d79d95c369ed', 'cf8c4175-b91c-4379-b294-7987deb1c0b9', '8b3ed399-33d9-4080-bd55-eb21bb2370cb', '2279f9aa-a9e8-484a-9742-97cc86abbe29'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d7b43d91-9ad2-40ee-9158-606467bc3623 tempest-ProjectReaderTests-124678288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d7b43d91-9ad2-40ee-9158-606467bc3623 tempest-ProjectReaderTests-124678288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:08 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d7b43d91-9ad2-40ee-9158-606467bc3623 tempest-ProjectReaderTests-124678288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:08 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d7b43d91-9ad2-40ee-9158-606467bc3623 tempest-ProjectReaderTests-124678288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d7b43d91-9ad2-40ee-9158-606467bc3623 tempest-ProjectReaderTests-124678288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d7b43d91-9ad2-40ee-9158-606467bc3623 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:08 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:03:08 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:08 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-721cf3f0-9645-4bd0-bf4a-e61c3f85786a tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e718e9c-bb69-482c-935a-9b009de71c4d -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.36f2a6a0-ee85-44b9-9581-94860c9d603d" returned: 0 in 0.466s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:08 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-721cf3f0-9645-4bd0-bf4a-e61c3f85786a tempest-ProjectMemberTests-1074212560 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.36f2a6a0-ee85-44b9-9581-94860c9d603d is being set with open permissions: ugo+rw Nov 05 04:03:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-721cf3f0-9645-4bd0-bf4a-e61c3f85786a tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.36f2a6a0-ee85-44b9-9581-94860c9d603d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:08 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.36f2a6a0-ee85-44b9-9581-94860c9d603d Nov 05 04:03:08 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:08 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d7b43d91-9ad2-40ee-9158-606467bc3623 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.389s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:08 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-d7b43d91-9ad2-40ee-9158-606467bc3623 tempest-ProjectReaderTests-124678288 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:03:08 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-d7b43d91-9ad2-40ee-9158-606467bc3623 tempest-ProjectReaderTests-124678288 None] Deleted volume successfully. Nov 05 04:03:08 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d7b43d91-9ad2-40ee-9158-606467bc3623 tempest-ProjectReaderTests-124678288 None] Lock "cinder-bc6efc4e-1f52-4d44-b629-583af644b9b0-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:08 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:08 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-721cf3f0-9645-4bd0-bf4a-e61c3f85786a tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.36f2a6a0-ee85-44b9-9581-94860c9d603d" returned: 0 in 0.488s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-721cf3f0-9645-4bd0-bf4a-e61c3f85786a tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:09 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.info Nov 05 04:03:09 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Flow 'volume_create_manager' (e21564f8-2c3a-4f52-9245-763276a64b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58c38e3-5538-4f22-91bc-36a4860c5cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58c38e3-5538-4f22-91bc-36a4860c5cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1810524380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a760d096-2403-421d-a08b-7823c4110634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f61cc92dd46408041e858fdab3dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:09Z,use_quota=True,user_id='840642882ebf4ec4ac16689c21ed946f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca2952c-f243-430e-9109-d68335a5eac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca2952c-f243-430e-9109-d68335a5eac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d395c9ac-dce7-491c-9783-7b4ef2126caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d395c9ac-dce7-491c-9783-7b4ef2126caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a760d096-2403-421d-a08b-7823c4110634', 'volume_name': 'volume-a760d096-2403-421d-a08b-7823c4110634', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2952fc-aeb1-479f-baa8-1c7a7ba7d662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2952fc-aeb1-479f-baa8-1c7a7ba7d662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d438a8ab-a342-49aa-8266-d714fca8ee81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:09 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Volume a760d096-2403-421d-a08b-7823c4110634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a760d096-2403-421d-a08b-7823c4110634', 'volume_size': 1} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:09 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-721cf3f0-9645-4bd0-bf4a-e61c3f85786a tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.info" returned: 0 in 0.290s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:09 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-721cf3f0-9645-4bd0-bf4a-e61c3f85786a tempest-ProjectMemberTests-1074212560 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.info is being set with open permissions: ugo+rw Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-721cf3f0-9645-4bd0-bf4a-e61c3f85786a tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:09 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.info Nov 05 04:03:09 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:09 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-721cf3f0-9645-4bd0-bf4a-e61c3f85786a tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.info" returned: 0 in 0.264s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-721cf3f0-9645-4bd0-bf4a-e61c3f85786a tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.740s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.305s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1810524380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a760d096-2403-421d-a08b-7823c4110634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e17f61cc92dd46408041e858fdab3dbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:09Z,use_quota=True,user_id='840642882ebf4ec4ac16689c21ed946f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Creating volume a760d096-2403-421d-a08b-7823c4110634 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:03:09 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:03:09 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:09 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634 1073741824 Nov 05 04:03:09 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:09 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-721cf3f0-9645-4bd0-bf4a-e61c3f85786a tempest-ProjectMemberTests-1074212560 None] Create snapshot completed successfully Nov 05 04:03:10 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634 1073741824" returned: 0 in 0.441s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-36f2a6a0-ee85-44b9-9581-94860c9d603d-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-36f2a6a0-ee85-44b9-9581-94860c9d603d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-7e718e9c-bb69-482c-935a-9b009de71c4d" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-7e718e9c-bb69-482c-935a-9b009de71c4d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-36f2a6a0-ee85-44b9-9581-94860c9d603d" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:10 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634 Nov 05 04:03:10 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-36f2a6a0-ee85-44b9-9581-94860c9d603d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] Deleting offline snapshot 36f2a6a0-ee85-44b9-9581-94860c9d603d of volume 7e718e9c-bb69-482c-935a-9b009de71c4d {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] snapshot_file for this snap is: volume-7e718e9c-bb69-482c-935a-9b009de71c4d.36f2a6a0-ee85-44b9-9581-94860c9d603d {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[4108ffa8-c748-4851-b51a-d6fadf4e28e9]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.36f2a6a0-ee85-44b9-9581-94860c9d603d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:10 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.36f2a6a0-ee85-44b9-9581-94860c9d603d Nov 05 04:03:10 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:10 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634" returned: 0 in 0.244s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d438a8ab-a342-49aa-8266-d714fca8ee81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a760d096-2403-421d-a08b-7823c4110634', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (406ff4f9-9d90-4571-88b4-db76d874317b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:10 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Volume volume-a760d096-2403-421d-a08b-7823c4110634 (a760d096-2403-421d-a08b-7823c4110634): created successfully Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (406ff4f9-9d90-4571-88b4-db76d874317b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Flow 'volume_create_manager' (e21564f8-2c3a-4f52-9245-763276a64b05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:10 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-ebd66fc4-fc91-4583-858d-a2272ed9a556 tempest-ProjectReaderTests-124678288 None] Created volume successfully. Nov 05 04:03:10 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.36f2a6a0-ee85-44b9-9581-94860c9d603d" returned: 0 in 0.381s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e718e9c-bb69-482c-935a-9b009de71c4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9ce875-805b-41a5-b649-3a3b4ebf7cfa]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:10 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d Nov 05 04:03:10 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:10 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d" returned: 0 in 0.360s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:10 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.36f2a6a0-ee85-44b9-9581-94860c9d603d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:10 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.36f2a6a0-ee85-44b9-9581-94860c9d603d Nov 05 04:03:10 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:11 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.36f2a6a0-ee85-44b9-9581-94860c9d603d" returned: 0 in 0.371s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.36f2a6a0-ee85-44b9-9581-94860c9d603d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:11 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.36f2a6a0-ee85-44b9-9581-94860c9d603d Nov 05 04:03:11 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-16fde34b-8406-4039-a535-536157d125d9 tempest-ProjectReaderTests-124678288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-16fde34b-8406-4039-a535-536157d125d9 tempest-ProjectReaderTests-124678288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:11 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-16fde34b-8406-4039-a535-536157d125d9 tempest-ProjectReaderTests-124678288 None] Creating offline snapshot 8b277906-e2d3-46e7-b479-ba1a26d199c3 of volume a760d096-2403-421d-a08b-7823c4110634 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:03:11 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4923ee4-4ab5-4f76-a61e-e675a143812d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-16fde34b-8406-4039-a535-536157d125d9 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:11 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634 Nov 05 04:03:11 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:11 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d.36f2a6a0-ee85-44b9-9581-94860c9d603d" returned: 0 in 0.268s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-36f2a6a0-ee85-44b9-9581-94860c9d603d" released by "_delete_snapshot" :: held 1.488s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-7e718e9c-bb69-482c-935a-9b009de71c4d" released by "delete_snapshot" :: held 1.508s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:11 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] Created reservations ['990b97dd-daa7-422d-b347-f2b2c38d126c', '4db817df-6a40-4369-8303-fc1279742590', '15b9d8b2-3576-4a33-865f-5aa42478eb60', '10ddc597-a31e-494c-b2db-0d2f916abb3f'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:11 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] Delete snapshot completed successfully. Nov 05 04:03:11 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d6dbde53-0c08-4936-9057-e3eda03d5b82 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-36f2a6a0-ee85-44b9-9581-94860c9d603d-delete_snapshot" released by "delete_snapshot" :: held 1.689s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:11 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-16fde34b-8406-4039-a535-536157d125d9 tempest-ProjectReaderTests-124678288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634" returned: 0 in 0.395s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:11 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-16fde34b-8406-4039-a535-536157d125d9 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.8b277906-e2d3-46e7-b479-ba1a26d199c3 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:11 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.8b277906-e2d3-46e7-b479-ba1a26d199c3 1G Nov 05 04:03:11 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-13e556e6-dc8b-4213-b647-46bd63dd27d8 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-7e718e9c-bb69-482c-935a-9b009de71c4d-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-13e556e6-dc8b-4213-b647-46bd63dd27d8 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-7e718e9c-bb69-482c-935a-9b009de71c4d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:12 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-16fde34b-8406-4039-a535-536157d125d9 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.8b277906-e2d3-46e7-b479-ba1a26d199c3 1G" returned: 0 in 0.436s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-16fde34b-8406-4039-a535-536157d125d9 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a760d096-2403-421d-a08b-7823c4110634 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.8b277906-e2d3-46e7-b479-ba1a26d199c3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-13e556e6-dc8b-4213-b647-46bd63dd27d8 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-7e718e9c-bb69-482c-935a-9b009de71c4d" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:12 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a760d096-2403-421d-a08b-7823c4110634 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.8b277906-e2d3-46e7-b479-ba1a26d199c3 Nov 05 04:03:12 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:12 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-13e556e6-dc8b-4213-b647-46bd63dd27d8 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-7e718e9c-bb69-482c-935a-9b009de71c4d" acquired by "delete_volume" :: waited 0.018s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:12 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be47055-4be9-4d5a-879c-b4c188538478]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-13e556e6-dc8b-4213-b647-46bd63dd27d8 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:12 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d Nov 05 04:03:12 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:12 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-16fde34b-8406-4039-a535-536157d125d9 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a760d096-2403-421d-a08b-7823c4110634 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.8b277906-e2d3-46e7-b479-ba1a26d199c3" returned: 0 in 0.310s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:12 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-16fde34b-8406-4039-a535-536157d125d9 tempest-ProjectReaderTests-124678288 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.8b277906-e2d3-46e7-b479-ba1a26d199c3 is being set with open permissions: ugo+rw Nov 05 04:03:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-16fde34b-8406-4039-a535-536157d125d9 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.8b277906-e2d3-46e7-b479-ba1a26d199c3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:12 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.8b277906-e2d3-46e7-b479-ba1a26d199c3 Nov 05 04:03:12 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:12 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-13e556e6-dc8b-4213-b647-46bd63dd27d8 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d" returned: 0 in 0.389s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-13e556e6-dc8b-4213-b647-46bd63dd27d8 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:12 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d Nov 05 04:03:12 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:12 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-16fde34b-8406-4039-a535-536157d125d9 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.8b277906-e2d3-46e7-b479-ba1a26d199c3" returned: 0 in 0.258s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:12 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-16fde34b-8406-4039-a535-536157d125d9 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:12 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.info Nov 05 04:03:12 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:13 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-13e556e6-dc8b-4213-b647-46bd63dd27d8 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7e718e9c-bb69-482c-935a-9b009de71c4d" returned: 0 in 0.255s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-13e556e6-dc8b-4213-b647-46bd63dd27d8 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-7e718e9c-bb69-482c-935a-9b009de71c4d" released by "delete_volume" :: held 0.709s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-13e556e6-dc8b-4213-b647-46bd63dd27d8 tempest-ProjectMemberTests-1074212560 None] Created reservations ['95ed4b82-2a76-403f-9f4f-72c0291328ff', 'b745d560-ec8e-410e-8aa5-135a65f3c1d1', '6b24534d-fb82-4c46-bf8f-deef584d421c', 'a367111a-b6aa-4f45-a225-4329c035299f'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:13 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-16fde34b-8406-4039-a535-536157d125d9 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.info" returned: 0 in 0.271s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:13 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-16fde34b-8406-4039-a535-536157d125d9 tempest-ProjectReaderTests-124678288 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.info is being set with open permissions: ugo+rw Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-16fde34b-8406-4039-a535-536157d125d9 tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-13e556e6-dc8b-4213-b647-46bd63dd27d8 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-13e556e6-dc8b-4213-b647-46bd63dd27d8 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-13e556e6-dc8b-4213-b647-46bd63dd27d8 tempest-ProjectMemberTests-1074212560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-13e556e6-dc8b-4213-b647-46bd63dd27d8 tempest-ProjectMemberTests-1074212560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-13e556e6-dc8b-4213-b647-46bd63dd27d8 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-13e556e6-dc8b-4213-b647-46bd63dd27d8 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:13 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.info Nov 05 04:03:13 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:13 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:03:13 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:13 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-16fde34b-8406-4039-a535-536157d125d9 tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.info" returned: 0 in 0.271s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:13 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-16fde34b-8406-4039-a535-536157d125d9 tempest-ProjectReaderTests-124678288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.033s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-13e556e6-dc8b-4213-b647-46bd63dd27d8 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.278s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-13e556e6-dc8b-4213-b647-46bd63dd27d8 tempest-ProjectMemberTests-1074212560 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:03:13 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-13e556e6-dc8b-4213-b647-46bd63dd27d8 tempest-ProjectMemberTests-1074212560 None] Deleted volume successfully. Nov 05 04:03:13 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-16fde34b-8406-4039-a535-536157d125d9 tempest-ProjectReaderTests-124678288 None] Create snapshot completed successfully Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-13e556e6-dc8b-4213-b647-46bd63dd27d8 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-7e718e9c-bb69-482c-935a-9b009de71c4d-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Flow 'volume_create_manager' (b9d6eae5-7c46-4d35-aba8-decefef6bd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c74ff3-d79a-4817-af06-1a675c0788b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c74ff3-d79a-4817-af06-1a675c0788b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1620542016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf2ea68-58af-49e7-9f65-596417cda6b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3010d6d3e434042bd27e53719a4555c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:14Z,use_quota=True,user_id='7b969d6cb8a54a0fb326f742289e9663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2686b334-d4eb-4a0e-9740-9edb71a695ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2686b334-d4eb-4a0e-9740-9edb71a695ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebce366e-61e1-4671-94ba-a916a74a91ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebce366e-61e1-4671-94ba-a916a74a91ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdf2ea68-58af-49e7-9f65-596417cda6b2', 'volume_name': 'volume-fdf2ea68-58af-49e7-9f65-596417cda6b2', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ed8c2c-85b2-43a0-8587-2315d510e89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ed8c2c-85b2-43a0-8587-2315d510e89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e30999-0fa0-42fa-99cf-710b6911fa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:13 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Volume fdf2ea68-58af-49e7-9f65-596417cda6b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdf2ea68-58af-49e7-9f65-596417cda6b2', 'volume_size': 1} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1620542016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf2ea68-58af-49e7-9f65-596417cda6b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3010d6d3e434042bd27e53719a4555c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:14Z,use_quota=True,user_id='7b969d6cb8a54a0fb326f742289e9663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Creating volume fdf2ea68-58af-49e7-9f65-596417cda6b2 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:03:13 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:03:13 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:14 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2 1073741824 Nov 05 04:03:14 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:14 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2 1073741824" returned: 0 in 0.414s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:14 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2 Nov 05 04:03:14 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-8b277906-e2d3-46e7-b479-ba1a26d199c3-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] Lock "cinder-8b277906-e2d3-46e7-b479-ba1a26d199c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-quobyte-a760d096-2403-421d-a08b-7823c4110634" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-a760d096-2403-421d-a08b-7823c4110634" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-quobyte-8b277906-e2d3-46e7-b479-ba1a26d199c3" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:14 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-8b277906-e2d3-46e7-b479-ba1a26d199c3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] Deleting offline snapshot 8b277906-e2d3-46e7-b479-ba1a26d199c3 of volume a760d096-2403-421d-a08b-7823c4110634 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:03:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] snapshot_file for this snap is: volume-a760d096-2403-421d-a08b-7823c4110634.8b277906-e2d3-46e7-b479-ba1a26d199c3 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:03:14 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:14 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c6816f-81a0-4343-9a78-fa5c275968c4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.8b277906-e2d3-46e7-b479-ba1a26d199c3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2" returned: 0 in 0.278s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:14 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:03:14 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4e30999-0fa0-42fa-99cf-710b6911fa5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf2ea68-58af-49e7-9f65-596417cda6b2', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d32682-8f4b-4cc9-adc7-4fe413a51442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:14 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Volume volume-fdf2ea68-58af-49e7-9f65-596417cda6b2 (fdf2ea68-58af-49e7-9f65-596417cda6b2): created successfully Nov 05 04:03:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d32682-8f4b-4cc9-adc7-4fe413a51442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:14 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Flow 'volume_create_manager' (b9d6eae5-7c46-4d35-aba8-decefef6bd00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:14 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f7d4c237-7a8d-4be0-b4b8-80ee6d147626 tempest-ProjectMemberTests-1074212560 None] Created volume successfully. Nov 05 04:03:14 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.8b277906-e2d3-46e7-b479-ba1a26d199c3 Nov 05 04:03:14 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-fe0d72ff-4253-4358-989f-82c1186da7a0 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-fe0d72ff-4253-4358-989f-82c1186da7a0 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-fe0d72ff-4253-4358-989f-82c1186da7a0 tempest-ProjectMemberTests-1074212560 None] Creating offline snapshot 197af629-7eda-44ef-93d3-cbc5d2e03029 of volume fdf2ea68-58af-49e7-9f65-596417cda6b2 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:03:15 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.8b277906-e2d3-46e7-b479-ba1a26d199c3" returned: 0 in 0.441s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:15 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a760d096-2403-421d-a08b-7823c4110634(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:03:15 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[9290f68f-cead-4f79-aeac-54d4c5696d9d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe0d72ff-4253-4358-989f-82c1186da7a0 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:15 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1906b2b6-0da1-47dd-a598-13de25c9496e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:15 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2 Nov 05 04:03:15 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:15 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634 Nov 05 04:03:15 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:15 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe0d72ff-4253-4358-989f-82c1186da7a0 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2" returned: 0 in 0.371s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe0d72ff-4253-4358-989f-82c1186da7a0 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.197af629-7eda-44ef-93d3-cbc5d2e03029 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:15 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.197af629-7eda-44ef-93d3-cbc5d2e03029 1G Nov 05 04:03:15 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:15 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634" returned: 0 in 0.394s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.8b277906-e2d3-46e7-b479-ba1a26d199c3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:15 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.8b277906-e2d3-46e7-b479-ba1a26d199c3 Nov 05 04:03:15 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:15 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.8b277906-e2d3-46e7-b479-ba1a26d199c3" returned: 0 in 0.355s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.8b277906-e2d3-46e7-b479-ba1a26d199c3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:15 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:15 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.8b277906-e2d3-46e7-b479-ba1a26d199c3 Nov 05 04:03:15 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe0d72ff-4253-4358-989f-82c1186da7a0 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.197af629-7eda-44ef-93d3-cbc5d2e03029 1G" returned: 0 in 0.419s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:15 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe0d72ff-4253-4358-989f-82c1186da7a0 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf2ea68-58af-49e7-9f65-596417cda6b2 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.197af629-7eda-44ef-93d3-cbc5d2e03029 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:15 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf2ea68-58af-49e7-9f65-596417cda6b2 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.197af629-7eda-44ef-93d3-cbc5d2e03029 Nov 05 04:03:15 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:16 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634.8b277906-e2d3-46e7-b479-ba1a26d199c3" returned: 0 in 0.254s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:16 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-8b277906-e2d3-46e7-b479-ba1a26d199c3" released by "_delete_snapshot" :: held 1.551s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:16 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-a760d096-2403-421d-a08b-7823c4110634" released by "delete_snapshot" :: held 1.577s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:16 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] Created reservations ['8c75c9c1-165f-4988-add0-f3886b566e84', '0e0fecb4-1250-4a48-8c6e-24d0726fd137', 'a2f5d79b-5a2a-4f14-bb59-875ec436730d', '10a055da-3a56-4161-8dd7-8f052808062f'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:16 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe0d72ff-4253-4358-989f-82c1186da7a0 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdf2ea68-58af-49e7-9f65-596417cda6b2 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.197af629-7eda-44ef-93d3-cbc5d2e03029" returned: 0 in 0.334s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:16 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-fe0d72ff-4253-4358-989f-82c1186da7a0 tempest-ProjectMemberTests-1074212560 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.197af629-7eda-44ef-93d3-cbc5d2e03029 is being set with open permissions: ugo+rw Nov 05 04:03:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe0d72ff-4253-4358-989f-82c1186da7a0 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.197af629-7eda-44ef-93d3-cbc5d2e03029 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:16 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.197af629-7eda-44ef-93d3-cbc5d2e03029 Nov 05 04:03:16 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:16 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] Delete snapshot completed successfully. Nov 05 04:03:16 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fe411423-dfed-4e92-8a01-008bfdf19cff tempest-ProjectReaderTests-124678288 None] Lock "cinder-8b277906-e2d3-46e7-b479-ba1a26d199c3-delete_snapshot" released by "delete_snapshot" :: held 1.779s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:16 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe0d72ff-4253-4358-989f-82c1186da7a0 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.197af629-7eda-44ef-93d3-cbc5d2e03029" returned: 0 in 0.275s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe0d72ff-4253-4358-989f-82c1186da7a0 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:16 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.info Nov 05 04:03:16 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:16 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b53c4171-1bbb-40d9-a9c3-be791af2a4fd tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-a760d096-2403-421d-a08b-7823c4110634-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:16 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b53c4171-1bbb-40d9-a9c3-be791af2a4fd tempest-ProjectReaderTests-124678288 None] Lock "cinder-a760d096-2403-421d-a08b-7823c4110634-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:16 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b53c4171-1bbb-40d9-a9c3-be791af2a4fd tempest-ProjectReaderTests-124678288 None] Acquiring lock "cinder-quobyte-a760d096-2403-421d-a08b-7823c4110634" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:16 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe0d72ff-4253-4358-989f-82c1186da7a0 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.info" returned: 0 in 0.284s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:16 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-fe0d72ff-4253-4358-989f-82c1186da7a0 tempest-ProjectMemberTests-1074212560 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.info is being set with open permissions: ugo+rw Nov 05 04:03:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe0d72ff-4253-4358-989f-82c1186da7a0 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:16 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b53c4171-1bbb-40d9-a9c3-be791af2a4fd tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-a760d096-2403-421d-a08b-7823c4110634" acquired by "delete_volume" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:16 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.info Nov 05 04:03:16 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:16 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccd2856-8a9b-40c5-92d7-c2c333af9c91]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:16 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b53c4171-1bbb-40d9-a9c3-be791af2a4fd tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:17 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634 Nov 05 04:03:17 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:17 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe0d72ff-4253-4358-989f-82c1186da7a0 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.info" returned: 0 in 0.258s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-fe0d72ff-4253-4358-989f-82c1186da7a0 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:17 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-fe0d72ff-4253-4358-989f-82c1186da7a0 tempest-ProjectMemberTests-1074212560 None] Create snapshot completed successfully Nov 05 04:03:17 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b53c4171-1bbb-40d9-a9c3-be791af2a4fd tempest-ProjectReaderTests-124678288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634" returned: 0 in 0.413s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b53c4171-1bbb-40d9-a9c3-be791af2a4fd tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:17 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634 Nov 05 04:03:17 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:17 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b53c4171-1bbb-40d9-a9c3-be791af2a4fd tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a760d096-2403-421d-a08b-7823c4110634" returned: 0 in 0.253s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:17 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b53c4171-1bbb-40d9-a9c3-be791af2a4fd tempest-ProjectReaderTests-124678288 None] Lock "cinder-quobyte-a760d096-2403-421d-a08b-7823c4110634" released by "delete_volume" :: held 0.734s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:17 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-b53c4171-1bbb-40d9-a9c3-be791af2a4fd tempest-ProjectReaderTests-124678288 None] Created reservations ['bcb67dd5-9fd1-485d-b8d9-45521fe8dc5d', 'dd4703bc-3132-41ca-ab35-31cad91ef670', '7643bb6a-a077-4054-9f7f-0a84e8826e0a', '2191b5df-611a-435f-832a-a117b443fa67'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b53c4171-1bbb-40d9-a9c3-be791af2a4fd tempest-ProjectReaderTests-124678288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b53c4171-1bbb-40d9-a9c3-be791af2a4fd tempest-ProjectReaderTests-124678288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b53c4171-1bbb-40d9-a9c3-be791af2a4fd tempest-ProjectReaderTests-124678288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:17 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-b53c4171-1bbb-40d9-a9c3-be791af2a4fd tempest-ProjectReaderTests-124678288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-b53c4171-1bbb-40d9-a9c3-be791af2a4fd tempest-ProjectReaderTests-124678288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:17 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b53c4171-1bbb-40d9-a9c3-be791af2a4fd tempest-ProjectReaderTests-124678288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:17 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:03:17 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:18 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-b53c4171-1bbb-40d9-a9c3-be791af2a4fd tempest-ProjectReaderTests-124678288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.277s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:18 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-b53c4171-1bbb-40d9-a9c3-be791af2a4fd tempest-ProjectReaderTests-124678288 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:03:18 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-b53c4171-1bbb-40d9-a9c3-be791af2a4fd tempest-ProjectReaderTests-124678288 None] Deleted volume successfully. Nov 05 04:03:18 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-b53c4171-1bbb-40d9-a9c3-be791af2a4fd tempest-ProjectReaderTests-124678288 None] Lock "cinder-a760d096-2403-421d-a08b-7823c4110634-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:18 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-197af629-7eda-44ef-93d3-cbc5d2e03029-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:18 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] Lock "cinder-197af629-7eda-44ef-93d3-cbc5d2e03029-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:18 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-fdf2ea68-58af-49e7-9f65-596417cda6b2" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:18 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-fdf2ea68-58af-49e7-9f65-596417cda6b2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:18 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-197af629-7eda-44ef-93d3-cbc5d2e03029" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:18 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-197af629-7eda-44ef-93d3-cbc5d2e03029" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] Deleting offline snapshot 197af629-7eda-44ef-93d3-cbc5d2e03029 of volume fdf2ea68-58af-49e7-9f65-596417cda6b2 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:03:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] snapshot_file for this snap is: volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.197af629-7eda-44ef-93d3-cbc5d2e03029 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:03:18 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[901e3653-e512-48e3-b957-44affd07d5bd]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.197af629-7eda-44ef-93d3-cbc5d2e03029 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:18 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.197af629-7eda-44ef-93d3-cbc5d2e03029 Nov 05 04:03:18 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:18 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.197af629-7eda-44ef-93d3-cbc5d2e03029" returned: 0 in 0.404s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:18 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdf2ea68-58af-49e7-9f65-596417cda6b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:03:18 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9b7d82-f875-4027-a4e4-02716c389b5e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:18 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:18 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2 Nov 05 04:03:18 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:19 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2" returned: 0 in 0.408s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.197af629-7eda-44ef-93d3-cbc5d2e03029 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:19 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.197af629-7eda-44ef-93d3-cbc5d2e03029 Nov 05 04:03:19 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:19 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.197af629-7eda-44ef-93d3-cbc5d2e03029" returned: 0 in 0.437s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.197af629-7eda-44ef-93d3-cbc5d2e03029 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:19 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.197af629-7eda-44ef-93d3-cbc5d2e03029 Nov 05 04:03:19 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:19 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:19 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2.197af629-7eda-44ef-93d3-cbc5d2e03029" returned: 0 in 0.264s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:19 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-197af629-7eda-44ef-93d3-cbc5d2e03029" released by "_delete_snapshot" :: held 1.637s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:19 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-fdf2ea68-58af-49e7-9f65-596417cda6b2" released by "delete_snapshot" :: held 1.665s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:20 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] Created reservations ['c777f8b8-49f3-4709-a48d-c48c3b93e176', 'ba9b1c8e-7bb9-403d-b2ee-edb2a0bf526e', '680b2026-8154-4b1f-a948-32a9ae2d0c3e', '72748278-8b4d-444d-85e4-a991c8efb603'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:20 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] Delete snapshot completed successfully. Nov 05 04:03:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-c489a618-e8ea-4f89-968c-ae37be5ef7ca tempest-ProjectMemberTests-1074212560 None] Lock "cinder-197af629-7eda-44ef-93d3-cbc5d2e03029-delete_snapshot" released by "delete_snapshot" :: held 1.819s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d4083157-9879-41d9-af86-ea00853b4cae tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-fdf2ea68-58af-49e7-9f65-596417cda6b2-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d4083157-9879-41d9-af86-ea00853b4cae tempest-ProjectMemberTests-1074212560 None] Lock "cinder-fdf2ea68-58af-49e7-9f65-596417cda6b2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d4083157-9879-41d9-af86-ea00853b4cae tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-fdf2ea68-58af-49e7-9f65-596417cda6b2" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:20 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d4083157-9879-41d9-af86-ea00853b4cae tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-fdf2ea68-58af-49e7-9f65-596417cda6b2" acquired by "delete_volume" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:20 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfba00cf-e3b3-4b71-a601-8e09a83797f0]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d4083157-9879-41d9-af86-ea00853b4cae tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:20 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2 Nov 05 04:03:20 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:20 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d4083157-9879-41d9-af86-ea00853b4cae tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2" returned: 0 in 0.381s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:20 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d4083157-9879-41d9-af86-ea00853b4cae tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:21 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2 Nov 05 04:03:21 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:21 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d4083157-9879-41d9-af86-ea00853b4cae tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-fdf2ea68-58af-49e7-9f65-596417cda6b2" returned: 0 in 0.266s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d4083157-9879-41d9-af86-ea00853b4cae tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-fdf2ea68-58af-49e7-9f65-596417cda6b2" released by "delete_volume" :: held 0.719s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:21 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-d4083157-9879-41d9-af86-ea00853b4cae tempest-ProjectMemberTests-1074212560 None] Created reservations ['b89756f7-2729-4a47-8661-b4a18f6cdcd0', '92edbebc-95a0-42f3-9a5b-5aaa791079c5', '5dd067a1-b395-4c43-87a5-d5baff73afc3', 'ed67bed5-8c39-4b0c-9ccc-29a97245dd44'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d4083157-9879-41d9-af86-ea00853b4cae tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d4083157-9879-41d9-af86-ea00853b4cae tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d4083157-9879-41d9-af86-ea00853b4cae tempest-ProjectMemberTests-1074212560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-d4083157-9879-41d9-af86-ea00853b4cae tempest-ProjectMemberTests-1074212560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d4083157-9879-41d9-af86-ea00853b4cae tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d4083157-9879-41d9-af86-ea00853b4cae tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:21 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:03:21 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:21 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d4083157-9879-41d9-af86-ea00853b4cae tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.264s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:21 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-d4083157-9879-41d9-af86-ea00853b4cae tempest-ProjectMemberTests-1074212560 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:03:21 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-d4083157-9879-41d9-af86-ea00853b4cae tempest-ProjectMemberTests-1074212560 None] Deleted volume successfully. Nov 05 04:03:21 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-d4083157-9879-41d9-af86-ea00853b4cae tempest-ProjectMemberTests-1074212560 None] Lock "cinder-fdf2ea68-58af-49e7-9f65-596417cda6b2-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Flow 'volume_create_manager' (fd5635a4-01d3-421d-a280-45f3ee8d8d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca0998f-f1fa-4e29-8678-922d59024532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca0998f-f1fa-4e29-8678-922d59024532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1204686073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1b6cee-88f0-46e2-81f5-abdd3997c296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3010d6d3e434042bd27e53719a4555c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:22Z,use_quota=True,user_id='7b969d6cb8a54a0fb326f742289e9663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4611391f-cc3f-4193-9ce3-ec8fcec3e72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4611391f-cc3f-4193-9ce3-ec8fcec3e72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf1ceb4-fafb-49f1-9cea-4322c8163f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf1ceb4-fafb-49f1-9cea-4322c8163f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a1b6cee-88f0-46e2-81f5-abdd3997c296', 'volume_name': 'volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (368287dc-214b-46b8-8b30-cb0d5f559483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (368287dc-214b-46b8-8b30-cb0d5f559483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606c2e85-4c44-4a35-b253-3ecf21a564dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:22 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Volume 4a1b6cee-88f0-46e2-81f5-abdd3997c296: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296', 'volume_size': 1} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1204686073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1b6cee-88f0-46e2-81f5-abdd3997c296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3010d6d3e434042bd27e53719a4555c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:22Z,use_quota=True,user_id='7b969d6cb8a54a0fb326f742289e9663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Creating volume 4a1b6cee-88f0-46e2-81f5-abdd3997c296 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:03:22 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:22 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296 1073741824 Nov 05 04:03:22 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:22 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296 1073741824" returned: 0 in 0.413s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:22 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296 Nov 05 04:03:22 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:22 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296" returned: 0 in 0.258s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606c2e85-4c44-4a35-b253-3ecf21a564dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab7e05f-587c-4522-80dd-874226cef057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:22 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Volume volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296 (4a1b6cee-88f0-46e2-81f5-abdd3997c296): created successfully Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab7e05f-587c-4522-80dd-874226cef057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Flow 'volume_create_manager' (fd5635a4-01d3-421d-a280-45f3ee8d8d08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:23 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-bd62c192-2ad7-4d20-8726-45b20784e61e tempest-ProjectMemberTests-1074212560 None] Created volume successfully. Nov 05 04:03:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-28a3b1eb-a2cb-4067-9e8c-e799ac9d1081 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-28a3b1eb-a2cb-4067-9e8c-e799ac9d1081 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:23 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-28a3b1eb-a2cb-4067-9e8c-e799ac9d1081 tempest-ProjectMemberTests-1074212560 None] Creating offline snapshot 8082a2e0-3532-4ce4-bff8-8a0158569779 of volume 4a1b6cee-88f0-46e2-81f5-abdd3997c296 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:03:23 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[4984646a-0ae1-484c-9a13-be8e287c0db0]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-28a3b1eb-a2cb-4067-9e8c-e799ac9d1081 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:23 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296 Nov 05 04:03:23 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:23 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-28a3b1eb-a2cb-4067-9e8c-e799ac9d1081 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296" returned: 0 in 0.388s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-28a3b1eb-a2cb-4067-9e8c-e799ac9d1081 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.8082a2e0-3532-4ce4-bff8-8a0158569779 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:23 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.8082a2e0-3532-4ce4-bff8-8a0158569779 1G Nov 05 04:03:23 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:24 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-28a3b1eb-a2cb-4067-9e8c-e799ac9d1081 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.8082a2e0-3532-4ce4-bff8-8a0158569779 1G" returned: 0 in 0.373s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-28a3b1eb-a2cb-4067-9e8c-e799ac9d1081 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.8082a2e0-3532-4ce4-bff8-8a0158569779 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:24 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.8082a2e0-3532-4ce4-bff8-8a0158569779 Nov 05 04:03:24 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:24 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-28a3b1eb-a2cb-4067-9e8c-e799ac9d1081 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.8082a2e0-3532-4ce4-bff8-8a0158569779" returned: 0 in 0.272s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:24 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-28a3b1eb-a2cb-4067-9e8c-e799ac9d1081 tempest-ProjectMemberTests-1074212560 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.8082a2e0-3532-4ce4-bff8-8a0158569779 is being set with open permissions: ugo+rw Nov 05 04:03:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-28a3b1eb-a2cb-4067-9e8c-e799ac9d1081 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.8082a2e0-3532-4ce4-bff8-8a0158569779 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:24 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.8082a2e0-3532-4ce4-bff8-8a0158569779 Nov 05 04:03:24 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:24 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-28a3b1eb-a2cb-4067-9e8c-e799ac9d1081 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.8082a2e0-3532-4ce4-bff8-8a0158569779" returned: 0 in 0.232s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-28a3b1eb-a2cb-4067-9e8c-e799ac9d1081 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:24 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.info Nov 05 04:03:24 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:24 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-28a3b1eb-a2cb-4067-9e8c-e799ac9d1081 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.info" returned: 0 in 0.301s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:24 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-28a3b1eb-a2cb-4067-9e8c-e799ac9d1081 tempest-ProjectMemberTests-1074212560 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.info is being set with open permissions: ugo+rw Nov 05 04:03:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-28a3b1eb-a2cb-4067-9e8c-e799ac9d1081 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:24 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.info Nov 05 04:03:24 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:25 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-28a3b1eb-a2cb-4067-9e8c-e799ac9d1081 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.info" returned: 0 in 0.258s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-28a3b1eb-a2cb-4067-9e8c-e799ac9d1081 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.915s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:25 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-28a3b1eb-a2cb-4067-9e8c-e799ac9d1081 tempest-ProjectMemberTests-1074212560 None] Create snapshot completed successfully Nov 05 04:03:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-8082a2e0-3532-4ce4-bff8-8a0158569779-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-8082a2e0-3532-4ce4-bff8-8a0158569779-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-4a1b6cee-88f0-46e2-81f5-abdd3997c296" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-4a1b6cee-88f0-46e2-81f5-abdd3997c296" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-8082a2e0-3532-4ce4-bff8-8a0158569779" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-8082a2e0-3532-4ce4-bff8-8a0158569779" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] Deleting offline snapshot 8082a2e0-3532-4ce4-bff8-8a0158569779 of volume 4a1b6cee-88f0-46e2-81f5-abdd3997c296 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:03:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] snapshot_file for this snap is: volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.8082a2e0-3532-4ce4-bff8-8a0158569779 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:03:25 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e63c088-2b6e-4f6d-bc36-44adc91f8422]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.8082a2e0-3532-4ce4-bff8-8a0158569779 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:25 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.8082a2e0-3532-4ce4-bff8-8a0158569779 Nov 05 04:03:25 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:25 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.8082a2e0-3532-4ce4-bff8-8a0158569779" returned: 0 in 0.344s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:03:25 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf9cde4-c713-449a-9431-d7e2e1f90e6b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:26 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296 Nov 05 04:03:26 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:26 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296" returned: 0 in 0.340s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.8082a2e0-3532-4ce4-bff8-8a0158569779 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:26 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.8082a2e0-3532-4ce4-bff8-8a0158569779 Nov 05 04:03:26 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:26 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.8082a2e0-3532-4ce4-bff8-8a0158569779" returned: 0 in 0.394s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.8082a2e0-3532-4ce4-bff8-8a0158569779 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:26 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.8082a2e0-3532-4ce4-bff8-8a0158569779 Nov 05 04:03:26 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:26 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296.8082a2e0-3532-4ce4-bff8-8a0158569779" returned: 0 in 0.269s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-8082a2e0-3532-4ce4-bff8-8a0158569779" released by "_delete_snapshot" :: held 1.442s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-4a1b6cee-88f0-46e2-81f5-abdd3997c296" released by "delete_snapshot" :: held 1.464s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:27 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] Created reservations ['3f2a106b-3f60-4a4d-84a7-0ed9aa88d53d', '95709b1f-71be-457f-9670-fe3dfb1f0e9e', 'e7577fc0-0a95-48e8-9155-35ae47ff9f05', '66dcc2c6-e74d-4650-8e58-68a682711592'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:27 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] Delete snapshot completed successfully. Nov 05 04:03:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-4d9fa221-23d0-4241-bc44-9fc0fff12825 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-8082a2e0-3532-4ce4-bff8-8a0158569779-delete_snapshot" released by "delete_snapshot" :: held 1.651s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-53db97cb-3893-4e93-bcc7-528726a8ecf6 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-4a1b6cee-88f0-46e2-81f5-abdd3997c296-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-53db97cb-3893-4e93-bcc7-528726a8ecf6 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-4a1b6cee-88f0-46e2-81f5-abdd3997c296-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-53db97cb-3893-4e93-bcc7-528726a8ecf6 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-4a1b6cee-88f0-46e2-81f5-abdd3997c296" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:27 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-53db97cb-3893-4e93-bcc7-528726a8ecf6 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-4a1b6cee-88f0-46e2-81f5-abdd3997c296" acquired by "delete_volume" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:27 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ef4574-e92e-4ee8-b463-05355d1e3681]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:27 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-53db97cb-3893-4e93-bcc7-528726a8ecf6 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:27 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296 Nov 05 04:03:27 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:28 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-53db97cb-3893-4e93-bcc7-528726a8ecf6 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296" returned: 0 in 0.374s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-53db97cb-3893-4e93-bcc7-528726a8ecf6 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:28 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296 Nov 05 04:03:28 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:28 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-53db97cb-3893-4e93-bcc7-528726a8ecf6 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-4a1b6cee-88f0-46e2-81f5-abdd3997c296" returned: 0 in 0.254s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-53db97cb-3893-4e93-bcc7-528726a8ecf6 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-4a1b6cee-88f0-46e2-81f5-abdd3997c296" released by "delete_volume" :: held 0.698s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:28 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-53db97cb-3893-4e93-bcc7-528726a8ecf6 tempest-ProjectMemberTests-1074212560 None] Created reservations ['c765a6d4-7448-4123-a6d5-d7acc4a28a64', 'cf17af12-85e5-4cf4-b147-1ecea98f4945', '728180a9-fb27-4400-ba6e-dd83829ed260', '3fa311fa-75cd-4e35-932e-6a0621d41992'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-53db97cb-3893-4e93-bcc7-528726a8ecf6 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-53db97cb-3893-4e93-bcc7-528726a8ecf6 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:28 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-53db97cb-3893-4e93-bcc7-528726a8ecf6 tempest-ProjectMemberTests-1074212560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:28 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-53db97cb-3893-4e93-bcc7-528726a8ecf6 tempest-ProjectMemberTests-1074212560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-53db97cb-3893-4e93-bcc7-528726a8ecf6 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-53db97cb-3893-4e93-bcc7-528726a8ecf6 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:28 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:03:28 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:28 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:28 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-53db97cb-3893-4e93-bcc7-528726a8ecf6 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.252s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:28 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-53db97cb-3893-4e93-bcc7-528726a8ecf6 tempest-ProjectMemberTests-1074212560 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:03:28 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-53db97cb-3893-4e93-bcc7-528726a8ecf6 tempest-ProjectMemberTests-1074212560 None] Deleted volume successfully. Nov 05 04:03:28 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-53db97cb-3893-4e93-bcc7-528726a8ecf6 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-4a1b6cee-88f0-46e2-81f5-abdd3997c296-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Flow 'volume_create_manager' (a7deddca-51d3-4b9c-9213-422e2d40cde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3221aa5e-f9ba-4c77-85d3-e3c688ac1e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3221aa5e-f9ba-4c77-85d3-e3c688ac1e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1716248136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac46444-0ab4-457a-95db-e89bca8c4477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3010d6d3e434042bd27e53719a4555c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:29Z,use_quota=True,user_id='7b969d6cb8a54a0fb326f742289e9663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116804ba-cd4a-475e-b1e4-6a293dfe0e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116804ba-cd4a-475e-b1e4-6a293dfe0e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046742dc-f741-4a1f-8726-bdac661a98a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046742dc-f741-4a1f-8726-bdac661a98a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ac46444-0ab4-457a-95db-e89bca8c4477', 'volume_name': 'volume-1ac46444-0ab4-457a-95db-e89bca8c4477', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae1d757-d076-415e-b681-21a7a4a965a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dae1d757-d076-415e-b681-21a7a4a965a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f97a5d8-e0f2-4934-8cea-ab33410401ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:29 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Volume 1ac46444-0ab4-457a-95db-e89bca8c4477: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ac46444-0ab4-457a-95db-e89bca8c4477', 'volume_size': 1} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1716248136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac46444-0ab4-457a-95db-e89bca8c4477,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3010d6d3e434042bd27e53719a4555c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:29Z,use_quota=True,user_id='7b969d6cb8a54a0fb326f742289e9663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Creating volume 1ac46444-0ab4-457a-95db-e89bca8c4477 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:03:29 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:29 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477 1073741824 Nov 05 04:03:29 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:29 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477 1073741824" returned: 0 in 0.448s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:29 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:29 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477 Nov 05 04:03:29 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:30 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477" returned: 0 in 0.262s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f97a5d8-e0f2-4934-8cea-ab33410401ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ac46444-0ab4-457a-95db-e89bca8c4477', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d115e2-79e1-4fff-ace5-1e1e2a602ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:30 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Volume volume-1ac46444-0ab4-457a-95db-e89bca8c4477 (1ac46444-0ab4-457a-95db-e89bca8c4477): created successfully Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d115e2-79e1-4fff-ace5-1e1e2a602ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Flow 'volume_create_manager' (a7deddca-51d3-4b9c-9213-422e2d40cde5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:30 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-4f6cc65d-c2e2-4844-90b3-78bed358fb9e tempest-ProjectMemberTests-1074212560 None] Created volume successfully. Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Flow 'volume_create_manager' (b0e1ed64-c323-4080-a309-cf50228a456a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ed6398-eedb-43cc-8a81-5187d24e4691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ed6398-eedb-43cc-8a81-5187d24e4691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1916203323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731e1c95-078e-45b4-ab57-f9452b4da5e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc5fbd635b4402b9fcf8c66764d2691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:30Z,use_quota=True,user_id='d4a9fadb31bd47b3acb36428d8197afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95fb70c9-542c-411a-af6d-391cce1bee9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95fb70c9-542c-411a-af6d-391cce1bee9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677c7d13-dbdf-44d7-8ec5-9526508b0e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677c7d13-dbdf-44d7-8ec5-9526508b0e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '731e1c95-078e-45b4-ab57-f9452b4da5e5', 'volume_name': 'volume-731e1c95-078e-45b4-ab57-f9452b4da5e5', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3062be0f-04a0-4fdb-8e39-fc355bae9951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3062be0f-04a0-4fdb-8e39-fc355bae9951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe85d40-a2a0-4511-853f-18185a9bc5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:30 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Volume 731e1c95-078e-45b4-ab57-f9452b4da5e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-731e1c95-078e-45b4-ab57-f9452b4da5e5', 'volume_size': 1} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1916203323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=731e1c95-078e-45b4-ab57-f9452b4da5e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc5fbd635b4402b9fcf8c66764d2691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:30Z,use_quota=True,user_id='d4a9fadb31bd47b3acb36428d8197afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Creating volume 731e1c95-078e-45b4-ab57-f9452b4da5e5 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:03:30 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-731e1c95-078e-45b4-ab57-f9452b4da5e5 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:30 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-066ce53b-64f5-40bd-8326-d50617a5f468 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:30 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-731e1c95-078e-45b4-ab57-f9452b4da5e5 1073741824 Nov 05 04:03:30 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:31 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-731e1c95-078e-45b4-ab57-f9452b4da5e5 1073741824" returned: 0 in 0.395s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-731e1c95-078e-45b4-ab57-f9452b4da5e5 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:31 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-731e1c95-078e-45b4-ab57-f9452b4da5e5 Nov 05 04:03:31 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:31 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-731e1c95-078e-45b4-ab57-f9452b4da5e5" returned: 0 in 0.226s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] <== create_volume: return (657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:03:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.660s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-066ce53b-64f5-40bd-8326-d50617a5f468 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.627s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe85d40-a2a0-4511-853f-18185a9bc5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-731e1c95-078e-45b4-ab57-f9452b4da5e5', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef15286-9624-4c26-94d3-fcbfc858ad7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:31 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-066ce53b-64f5-40bd-8326-d50617a5f468 tempest-ProjectMemberTests-1074212560 None] Creating offline snapshot 15737693-3cec-4fc5-924e-11c78a4b1c2d of volume 1ac46444-0ab4-457a-95db-e89bca8c4477 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:03:31 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Volume volume-731e1c95-078e-45b4-ab57-f9452b4da5e5 (731e1c95-078e-45b4-ab57-f9452b4da5e5): created successfully Nov 05 04:03:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef15286-9624-4c26-94d3-fcbfc858ad7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:31 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Flow 'volume_create_manager' (b0e1ed64-c323-4080-a309-cf50228a456a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:31 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa2ed0c-5598-48f2-bba7-771ab52bc647]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-066ce53b-64f5-40bd-8326-d50617a5f468 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:31 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-334a8694-63f7-4ae9-ba3f-56cf5260e2ff tempest-ProjectReaderTests-1976089566 None] Created volume successfully. Nov 05 04:03:31 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477 Nov 05 04:03:31 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-56146f03-22cb-4f27-a817-43aa644e1fad tempest-ProjectReaderTests-1976089566 None] Acquiring lock "cinder-731e1c95-078e-45b4-ab57-f9452b4da5e5-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-56146f03-22cb-4f27-a817-43aa644e1fad tempest-ProjectReaderTests-1976089566 None] Lock "cinder-731e1c95-078e-45b4-ab57-f9452b4da5e5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-56146f03-22cb-4f27-a817-43aa644e1fad tempest-ProjectReaderTests-1976089566 None] Acquiring lock "cinder-quobyte-731e1c95-078e-45b4-ab57-f9452b4da5e5" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:31 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-56146f03-22cb-4f27-a817-43aa644e1fad tempest-ProjectReaderTests-1976089566 None] Lock "cinder-quobyte-731e1c95-078e-45b4-ab57-f9452b4da5e5" acquired by "delete_volume" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:31 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-066ce53b-64f5-40bd-8326-d50617a5f468 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477" returned: 0 in 0.417s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-066ce53b-64f5-40bd-8326-d50617a5f468 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.15737693-3cec-4fc5-924e-11c78a4b1c2d 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:31 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c146153b-5b61-49cc-86a6-525381eb9c7e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-56146f03-22cb-4f27-a817-43aa644e1fad tempest-ProjectReaderTests-1976089566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-731e1c95-078e-45b4-ab57-f9452b4da5e5 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:31 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.15737693-3cec-4fc5-924e-11c78a4b1c2d 1G Nov 05 04:03:31 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:31 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-731e1c95-078e-45b4-ab57-f9452b4da5e5 Nov 05 04:03:31 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:32 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-066ce53b-64f5-40bd-8326-d50617a5f468 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.15737693-3cec-4fc5-924e-11c78a4b1c2d 1G" returned: 0 in 0.380s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-066ce53b-64f5-40bd-8326-d50617a5f468 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ac46444-0ab4-457a-95db-e89bca8c4477 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.15737693-3cec-4fc5-924e-11c78a4b1c2d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:32 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-56146f03-22cb-4f27-a817-43aa644e1fad tempest-ProjectReaderTests-1976089566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-731e1c95-078e-45b4-ab57-f9452b4da5e5" returned: 0 in 0.381s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-56146f03-22cb-4f27-a817-43aa644e1fad tempest-ProjectReaderTests-1976089566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-731e1c95-078e-45b4-ab57-f9452b4da5e5 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:32 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ac46444-0ab4-457a-95db-e89bca8c4477 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.15737693-3cec-4fc5-924e-11c78a4b1c2d Nov 05 04:03:32 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:32 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-731e1c95-078e-45b4-ab57-f9452b4da5e5 Nov 05 04:03:32 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:32 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-56146f03-22cb-4f27-a817-43aa644e1fad tempest-ProjectReaderTests-1976089566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-731e1c95-078e-45b4-ab57-f9452b4da5e5" returned: 0 in 0.247s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-56146f03-22cb-4f27-a817-43aa644e1fad tempest-ProjectReaderTests-1976089566 None] Lock "cinder-quobyte-731e1c95-078e-45b4-ab57-f9452b4da5e5" released by "delete_volume" :: held 0.683s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:32 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-066ce53b-64f5-40bd-8326-d50617a5f468 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ac46444-0ab4-457a-95db-e89bca8c4477 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.15737693-3cec-4fc5-924e-11c78a4b1c2d" returned: 0 in 0.322s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:32 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-066ce53b-64f5-40bd-8326-d50617a5f468 tempest-ProjectMemberTests-1074212560 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.15737693-3cec-4fc5-924e-11c78a4b1c2d is being set with open permissions: ugo+rw Nov 05 04:03:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-066ce53b-64f5-40bd-8326-d50617a5f468 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.15737693-3cec-4fc5-924e-11c78a4b1c2d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:32 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-56146f03-22cb-4f27-a817-43aa644e1fad tempest-ProjectReaderTests-1976089566 None] Created reservations ['1da05417-5251-428d-ab32-d76ac8d2e68b', '7108c262-52c8-4414-88e4-40f4305c4a75', '0cfa6894-ade1-41b5-935b-912c33978c59', '6d7cae71-38ee-41b7-be90-1544b89ec750'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:32 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.15737693-3cec-4fc5-924e-11c78a4b1c2d Nov 05 04:03:32 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-56146f03-22cb-4f27-a817-43aa644e1fad tempest-ProjectReaderTests-1976089566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-56146f03-22cb-4f27-a817-43aa644e1fad tempest-ProjectReaderTests-1976089566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-56146f03-22cb-4f27-a817-43aa644e1fad tempest-ProjectReaderTests-1976089566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-56146f03-22cb-4f27-a817-43aa644e1fad tempest-ProjectReaderTests-1976089566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-56146f03-22cb-4f27-a817-43aa644e1fad tempest-ProjectReaderTests-1976089566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-56146f03-22cb-4f27-a817-43aa644e1fad tempest-ProjectReaderTests-1976089566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:32 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:03:32 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:32 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-066ce53b-64f5-40bd-8326-d50617a5f468 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.15737693-3cec-4fc5-924e-11c78a4b1c2d" returned: 0 in 0.256s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-066ce53b-64f5-40bd-8326-d50617a5f468 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:32 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.info Nov 05 04:03:32 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:32 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-56146f03-22cb-4f27-a817-43aa644e1fad tempest-ProjectReaderTests-1976089566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.280s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:32 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-56146f03-22cb-4f27-a817-43aa644e1fad tempest-ProjectReaderTests-1976089566 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:03:32 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-56146f03-22cb-4f27-a817-43aa644e1fad tempest-ProjectReaderTests-1976089566 None] Deleted volume successfully. Nov 05 04:03:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-56146f03-22cb-4f27-a817-43aa644e1fad tempest-ProjectReaderTests-1976089566 None] Lock "cinder-731e1c95-078e-45b4-ab57-f9452b4da5e5-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:33 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-066ce53b-64f5-40bd-8326-d50617a5f468 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.info" returned: 0 in 0.290s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:33 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-066ce53b-64f5-40bd-8326-d50617a5f468 tempest-ProjectMemberTests-1074212560 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.info is being set with open permissions: ugo+rw Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-066ce53b-64f5-40bd-8326-d50617a5f468 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:33 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.info Nov 05 04:03:33 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:33 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-066ce53b-64f5-40bd-8326-d50617a5f468 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.info" returned: 0 in 0.276s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-066ce53b-64f5-40bd-8326-d50617a5f468 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Flow 'volume_create_manager' (1ea01674-caa5-4239-a3c2-0919c7594fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5d6295-ed93-4e19-ab43-8133df230458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:33 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-066ce53b-64f5-40bd-8326-d50617a5f468 tempest-ProjectMemberTests-1074212560 None] Create snapshot completed successfully Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5d6295-ed93-4e19-ab43-8133df230458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1768924244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc5fbd635b4402b9fcf8c66764d2691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:33Z,use_quota=True,user_id='d4a9fadb31bd47b3acb36428d8197afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26bb9ada-d594-4740-a43d-a7ecbf18adb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26bb9ada-d594-4740-a43d-a7ecbf18adb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a128495-1fea-4fba-add5-2ecf1889d533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a128495-1fea-4fba-add5-2ecf1889d533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc', 'volume_name': 'volume-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63ad9fd-190a-4358-99e5-01a41a86ff09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c63ad9fd-190a-4358-99e5-01a41a86ff09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c138fc-61e9-4953-a895-2ee6acc9dcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:33 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Volume 7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc', 'volume_size': 1} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1768924244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc5fbd635b4402b9fcf8c66764d2691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:33Z,use_quota=True,user_id='d4a9fadb31bd47b3acb36428d8197afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Creating volume 7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:03:33 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:33 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc 1073741824 Nov 05 04:03:33 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-15737693-3cec-4fc5-924e-11c78a4b1c2d-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-15737693-3cec-4fc5-924e-11c78a4b1c2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-1ac46444-0ab4-457a-95db-e89bca8c4477" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-1ac46444-0ab4-457a-95db-e89bca8c4477" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-15737693-3cec-4fc5-924e-11c78a4b1c2d" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-15737693-3cec-4fc5-924e-11c78a4b1c2d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] Deleting offline snapshot 15737693-3cec-4fc5-924e-11c78a4b1c2d of volume 1ac46444-0ab4-457a-95db-e89bca8c4477 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] snapshot_file for this snap is: volume-1ac46444-0ab4-457a-95db-e89bca8c4477.15737693-3cec-4fc5-924e-11c78a4b1c2d {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a19c156-7fc4-4410-ad63-7129edbb6889]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.15737693-3cec-4fc5-924e-11c78a4b1c2d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:33 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.15737693-3cec-4fc5-924e-11c78a4b1c2d Nov 05 04:03:33 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:33 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc 1073741824" returned: 0 in 0.456s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:34 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc Nov 05 04:03:34 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:34 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.15737693-3cec-4fc5-924e-11c78a4b1c2d" returned: 0 in 0.373s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ac46444-0ab4-457a-95db-e89bca8c4477(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:03:34 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd26e31-58b9-4063-a83a-7cc6432a2b0b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:34 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc" returned: 0 in 0.263s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:34 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:03:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9c138fc-61e9-4953-a895-2ee6acc9dcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45207bd2-e6cd-426c-b762-1529a7284fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:34 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Volume volume-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc (7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc): created successfully Nov 05 04:03:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45207bd2-e6cd-426c-b762-1529a7284fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:34 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Flow 'volume_create_manager' (1ea01674-caa5-4239-a3c2-0919c7594fa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:34 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-9d30e65f-4907-43e9-ba79-dbe1d224cac5 tempest-ProjectReaderTests-1976089566 None] Created volume successfully. Nov 05 04:03:34 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477 Nov 05 04:03:34 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:34 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477" returned: 0 in 0.352s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.15737693-3cec-4fc5-924e-11c78a4b1c2d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:34 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.15737693-3cec-4fc5-924e-11c78a4b1c2d Nov 05 04:03:34 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:34 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.15737693-3cec-4fc5-924e-11c78a4b1c2d" returned: 0 in 0.331s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.15737693-3cec-4fc5-924e-11c78a4b1c2d {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:34 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.15737693-3cec-4fc5-924e-11c78a4b1c2d Nov 05 04:03:34 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:35 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477.15737693-3cec-4fc5-924e-11c78a4b1c2d" returned: 0 in 0.248s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-15737693-3cec-4fc5-924e-11c78a4b1c2d" released by "_delete_snapshot" :: held 1.409s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-1ac46444-0ab4-457a-95db-e89bca8c4477" released by "delete_snapshot" :: held 1.432s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:35 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] Created reservations ['0bfa3656-eb7e-41f9-8649-a93ea2c07765', 'a9a8dc68-b33e-4965-a8f5-da8a6a78ff1f', 'cd9bc399-f9c9-4a34-818c-0122655edf37', '4e7727a0-ee2f-43aa-888c-03e7c4443581'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:35 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] Delete snapshot completed successfully. Nov 05 04:03:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-82292f11-086f-40c6-9f53-88337625b517 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-15737693-3cec-4fc5-924e-11c78a4b1c2d-delete_snapshot" released by "delete_snapshot" :: held 1.595s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-64f38ec0-2141-4e06-9341-6d13f46597bc tempest-ProjectReaderTests-1976089566 None] Acquiring lock "cinder-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-64f38ec0-2141-4e06-9341-6d13f46597bc tempest-ProjectReaderTests-1976089566 None] Lock "cinder-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-64f38ec0-2141-4e06-9341-6d13f46597bc tempest-ProjectReaderTests-1976089566 None] Acquiring lock "cinder-quobyte-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-64f38ec0-2141-4e06-9341-6d13f46597bc tempest-ProjectReaderTests-1976089566 None] Lock "cinder-quobyte-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc" acquired by "delete_volume" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:35 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0400dbd-8c90-47ea-9c28-11915648c976]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-64f38ec0-2141-4e06-9341-6d13f46597bc tempest-ProjectReaderTests-1976089566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:35 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc Nov 05 04:03:35 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6905f78e-ea18-4e1f-90ed-40b018fe8567 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-1ac46444-0ab4-457a-95db-e89bca8c4477-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6905f78e-ea18-4e1f-90ed-40b018fe8567 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-1ac46444-0ab4-457a-95db-e89bca8c4477-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6905f78e-ea18-4e1f-90ed-40b018fe8567 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-1ac46444-0ab4-457a-95db-e89bca8c4477" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6905f78e-ea18-4e1f-90ed-40b018fe8567 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-1ac46444-0ab4-457a-95db-e89bca8c4477" acquired by "delete_volume" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:35 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-64f38ec0-2141-4e06-9341-6d13f46597bc tempest-ProjectReaderTests-1976089566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc" returned: 0 in 0.396s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-64f38ec0-2141-4e06-9341-6d13f46597bc tempest-ProjectReaderTests-1976089566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:35 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9b7969-8772-4a1b-85cf-327be08d9eca]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6905f78e-ea18-4e1f-90ed-40b018fe8567 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:36 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc Nov 05 04:03:36 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:36 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477 Nov 05 04:03:36 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:36 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-64f38ec0-2141-4e06-9341-6d13f46597bc tempest-ProjectReaderTests-1976089566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc" returned: 0 in 0.254s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-64f38ec0-2141-4e06-9341-6d13f46597bc tempest-ProjectReaderTests-1976089566 None] Lock "cinder-quobyte-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc" released by "delete_volume" :: held 0.686s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-64f38ec0-2141-4e06-9341-6d13f46597bc tempest-ProjectReaderTests-1976089566 None] Created reservations ['f6944c4a-b84e-4675-819b-1d3bcb106c0c', '794be0e1-479b-47fc-8255-b2a0a5640609', '4da7ea02-471a-458a-ab0a-4cd2429bc207', 'b6580da4-42a3-4bfd-9d08-e2dd49a7d91f'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-64f38ec0-2141-4e06-9341-6d13f46597bc tempest-ProjectReaderTests-1976089566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-64f38ec0-2141-4e06-9341-6d13f46597bc tempest-ProjectReaderTests-1976089566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-64f38ec0-2141-4e06-9341-6d13f46597bc tempest-ProjectReaderTests-1976089566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:36 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-64f38ec0-2141-4e06-9341-6d13f46597bc tempest-ProjectReaderTests-1976089566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-64f38ec0-2141-4e06-9341-6d13f46597bc tempest-ProjectReaderTests-1976089566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-64f38ec0-2141-4e06-9341-6d13f46597bc tempest-ProjectReaderTests-1976089566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6905f78e-ea18-4e1f-90ed-40b018fe8567 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477" returned: 0 in 0.390s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6905f78e-ea18-4e1f-90ed-40b018fe8567 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:36 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:03:36 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:36 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477 Nov 05 04:03:36 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:36 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:36 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-64f38ec0-2141-4e06-9341-6d13f46597bc tempest-ProjectReaderTests-1976089566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.270s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-64f38ec0-2141-4e06-9341-6d13f46597bc tempest-ProjectReaderTests-1976089566 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6905f78e-ea18-4e1f-90ed-40b018fe8567 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1ac46444-0ab4-457a-95db-e89bca8c4477" returned: 0 in 0.263s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:36 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-64f38ec0-2141-4e06-9341-6d13f46597bc tempest-ProjectReaderTests-1976089566 None] Deleted volume successfully. Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6905f78e-ea18-4e1f-90ed-40b018fe8567 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-1ac46444-0ab4-457a-95db-e89bca8c4477" released by "delete_volume" :: held 0.723s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-64f38ec0-2141-4e06-9341-6d13f46597bc tempest-ProjectReaderTests-1976089566 None] Lock "cinder-7a0d71cf-8e8e-4e1c-af9c-fe52213d2dcc-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-6905f78e-ea18-4e1f-90ed-40b018fe8567 tempest-ProjectMemberTests-1074212560 None] Created reservations ['82bd1faf-3fdc-45f4-8987-cfd7aaac59c8', 'bd12a826-10ef-403f-befb-1e10b2f356c7', 'beeb7bea-d7d6-41c6-bc94-d2a3c74beef1', 'f44286b7-d070-46a5-809a-4894acff10f5'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6905f78e-ea18-4e1f-90ed-40b018fe8567 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6905f78e-ea18-4e1f-90ed-40b018fe8567 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6905f78e-ea18-4e1f-90ed-40b018fe8567 tempest-ProjectMemberTests-1074212560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-6905f78e-ea18-4e1f-90ed-40b018fe8567 tempest-ProjectMemberTests-1074212560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-6905f78e-ea18-4e1f-90ed-40b018fe8567 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6905f78e-ea18-4e1f-90ed-40b018fe8567 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:36 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:03:36 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:37 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-6905f78e-ea18-4e1f-90ed-40b018fe8567 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.269s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-6905f78e-ea18-4e1f-90ed-40b018fe8567 tempest-ProjectMemberTests-1074212560 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:03:37 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-6905f78e-ea18-4e1f-90ed-40b018fe8567 tempest-ProjectMemberTests-1074212560 None] Deleted volume successfully. Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-6905f78e-ea18-4e1f-90ed-40b018fe8567 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-1ac46444-0ab4-457a-95db-e89bca8c4477-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Flow 'volume_create_manager' (6f06e0bd-532f-4e88-9050-dc39968c0fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd054ad-557c-43ee-8e5b-791bcb873877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd054ad-557c-43ee-8e5b-791bcb873877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2037568340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f582e01-359f-4fd4-b001-26829b823a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc5fbd635b4402b9fcf8c66764d2691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:37Z,use_quota=True,user_id='d4a9fadb31bd47b3acb36428d8197afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2ded59-79b3-4726-bec3-383a274b2348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2ded59-79b3-4726-bec3-383a274b2348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c194f3-dff6-4b1e-a023-0c8c370e9cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c194f3-dff6-4b1e-a023-0c8c370e9cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f582e01-359f-4fd4-b001-26829b823a0b', 'volume_name': 'volume-1f582e01-359f-4fd4-b001-26829b823a0b', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2262ad26-fac8-4a28-8419-555109ab62b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2262ad26-fac8-4a28-8419-555109ab62b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a198d6f2-abe5-43af-bc7f-624fddf1db17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:37 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Volume 1f582e01-359f-4fd4-b001-26829b823a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f582e01-359f-4fd4-b001-26829b823a0b', 'volume_size': 1} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2037568340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f582e01-359f-4fd4-b001-26829b823a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc5fbd635b4402b9fcf8c66764d2691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:37Z,use_quota=True,user_id='d4a9fadb31bd47b3acb36428d8197afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Creating volume 1f582e01-359f-4fd4-b001-26829b823a0b {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:03:37 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1f582e01-359f-4fd4-b001-26829b823a0b 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:37 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1f582e01-359f-4fd4-b001-26829b823a0b 1073741824 Nov 05 04:03:37 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Flow 'volume_create_manager' (25267fe6-29e2-4e25-904b-efd69c2c9a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c88cccb-91ec-40e3-82c2-4866104d8e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c88cccb-91ec-40e3-82c2-4866104d8e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1611228045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3010d6d3e434042bd27e53719a4555c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:37Z,use_quota=True,user_id='7b969d6cb8a54a0fb326f742289e9663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2583b89-4dec-4220-a1c4-3760bcf2e586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2583b89-4dec-4220-a1c4-3760bcf2e586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd103f2-145a-4306-bf26-a8a4dd4ee043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd103f2-145a-4306-bf26-a8a4dd4ee043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0', 'volume_name': 'volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2419c5d0-6fbf-43c9-84e8-5cbf689b91bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2419c5d0-6fbf-43c9-84e8-5cbf689b91bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af5da14-c91d-40f8-a1b2-5f3764bd9647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:37 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Volume b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0', 'volume_size': 1} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:37 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1f582e01-359f-4fd4-b001-26829b823a0b 1073741824" returned: 0 in 0.429s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1f582e01-359f-4fd4-b001-26829b823a0b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:37 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1f582e01-359f-4fd4-b001-26829b823a0b Nov 05 04:03:37 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:37 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1f582e01-359f-4fd4-b001-26829b823a0b" returned: 0 in 0.242s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.360s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1611228045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3010d6d3e434042bd27e53719a4555c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:37Z,use_quota=True,user_id='7b969d6cb8a54a0fb326f742289e9663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Creating volume b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:03:38 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a198d6f2-abe5-43af-bc7f-624fddf1db17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f582e01-359f-4fd4-b001-26829b823a0b', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:38 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0 1073741824 Nov 05 04:03:38 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e345f0-d4fc-4f24-abac-c7992059b167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:38 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Volume volume-1f582e01-359f-4fd4-b001-26829b823a0b (1f582e01-359f-4fd4-b001-26829b823a0b): created successfully Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e345f0-d4fc-4f24-abac-c7992059b167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Flow 'volume_create_manager' (6f06e0bd-532f-4e88-9050-dc39968c0fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:38 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-c15626d4-8024-4c30-a6c5-3745e1e7bd60 tempest-ProjectReaderTests-1976089566 None] Created volume successfully. Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a13a6b57-f783-45b0-98ad-8b65f17c38d0 tempest-ProjectReaderTests-1976089566 None] Acquiring lock "cinder-1f582e01-359f-4fd4-b001-26829b823a0b-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a13a6b57-f783-45b0-98ad-8b65f17c38d0 tempest-ProjectReaderTests-1976089566 None] Lock "cinder-1f582e01-359f-4fd4-b001-26829b823a0b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a13a6b57-f783-45b0-98ad-8b65f17c38d0 tempest-ProjectReaderTests-1976089566 None] Acquiring lock "cinder-quobyte-1f582e01-359f-4fd4-b001-26829b823a0b" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a13a6b57-f783-45b0-98ad-8b65f17c38d0 tempest-ProjectReaderTests-1976089566 None] Lock "cinder-quobyte-1f582e01-359f-4fd4-b001-26829b823a0b" acquired by "delete_volume" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[73749e0f-cb6a-4280-932f-b63f12fa6c1c]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a13a6b57-f783-45b0-98ad-8b65f17c38d0 tempest-ProjectReaderTests-1976089566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1f582e01-359f-4fd4-b001-26829b823a0b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:38 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1f582e01-359f-4fd4-b001-26829b823a0b Nov 05 04:03:38 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:38 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0 1073741824" returned: 0 in 0.476s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:38 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0 Nov 05 04:03:38 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:38 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a13a6b57-f783-45b0-98ad-8b65f17c38d0 tempest-ProjectReaderTests-1976089566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1f582e01-359f-4fd4-b001-26829b823a0b" returned: 0 in 0.370s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a13a6b57-f783-45b0-98ad-8b65f17c38d0 tempest-ProjectReaderTests-1976089566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1f582e01-359f-4fd4-b001-26829b823a0b {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:38 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1f582e01-359f-4fd4-b001-26829b823a0b Nov 05 04:03:38 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:38 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0" returned: 0 in 0.252s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af5da14-c91d-40f8-a1b2-5f3764bd9647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa9e1c7-0e4a-4675-9eb7-b96d1ffcd5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:38 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Volume volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0 (b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0): created successfully Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa9e1c7-0e4a-4675-9eb7-b96d1ffcd5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Flow 'volume_create_manager' (25267fe6-29e2-4e25-904b-efd69c2c9a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:38 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-3aa4c63c-5d82-4459-aa33-a317a51b7986 tempest-ProjectMemberTests-1074212560 None] Created volume successfully. Nov 05 04:03:38 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a13a6b57-f783-45b0-98ad-8b65f17c38d0 tempest-ProjectReaderTests-1976089566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-1f582e01-359f-4fd4-b001-26829b823a0b" returned: 0 in 0.248s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:38 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a13a6b57-f783-45b0-98ad-8b65f17c38d0 tempest-ProjectReaderTests-1976089566 None] Lock "cinder-quobyte-1f582e01-359f-4fd4-b001-26829b823a0b" released by "delete_volume" :: held 0.661s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:39 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-a13a6b57-f783-45b0-98ad-8b65f17c38d0 tempest-ProjectReaderTests-1976089566 None] Created reservations ['bc0828cc-d843-4e8d-9607-d2de866e7c0e', 'ba2e6803-f7bd-4a53-a6a4-c2a9134fed45', '7e281750-beb7-4623-803d-6a91dfd16bd5', 'b61fd18b-3f82-40ce-ad91-2a8f634637b7'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a13a6b57-f783-45b0-98ad-8b65f17c38d0 tempest-ProjectReaderTests-1976089566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a13a6b57-f783-45b0-98ad-8b65f17c38d0 tempest-ProjectReaderTests-1976089566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a13a6b57-f783-45b0-98ad-8b65f17c38d0 tempest-ProjectReaderTests-1976089566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:39 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a13a6b57-f783-45b0-98ad-8b65f17c38d0 tempest-ProjectReaderTests-1976089566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a13a6b57-f783-45b0-98ad-8b65f17c38d0 tempest-ProjectReaderTests-1976089566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a13a6b57-f783-45b0-98ad-8b65f17c38d0 tempest-ProjectReaderTests-1976089566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:39 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:03:39 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:39 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a13a6b57-f783-45b0-98ad-8b65f17c38d0 tempest-ProjectReaderTests-1976089566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.238s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:39 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-a13a6b57-f783-45b0-98ad-8b65f17c38d0 tempest-ProjectReaderTests-1976089566 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:03:39 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-a13a6b57-f783-45b0-98ad-8b65f17c38d0 tempest-ProjectReaderTests-1976089566 None] Deleted volume successfully. Nov 05 04:03:39 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-a13a6b57-f783-45b0-98ad-8b65f17c38d0 tempest-ProjectReaderTests-1976089566 None] Lock "cinder-1f582e01-359f-4fd4-b001-26829b823a0b-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-afef6156-3526-40dd-9d1f-cc29503e2a07 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:39 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-afef6156-3526-40dd-9d1f-cc29503e2a07 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:39 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:03:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Flow 'volume_create_manager' (d242ca66-4784-4836-b374-8bd94de9fc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b19f2bd-11b2-404a-b8a6-15cdbaeb2639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:40 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-afef6156-3526-40dd-9d1f-cc29503e2a07 tempest-ProjectMemberTests-1074212560 None] Creating offline snapshot c777cd79-234c-458f-b202-935eb0bd37f9 of volume b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:03:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b19f2bd-11b2-404a-b8a6-15cdbaeb2639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115749942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc5fbd635b4402b9fcf8c66764d2691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:40Z,use_quota=True,user_id='d4a9fadb31bd47b3acb36428d8197afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27e78b6-8b71-4c70-85cd-0b5abc2403d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27e78b6-8b71-4c70-85cd-0b5abc2403d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a7072a-b86c-41ce-ac17-98450602aa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a7072a-b86c-41ce-ac17-98450602aa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb', 'volume_name': 'volume-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6500278d-f5a4-46b6-9415-2ae65c7a2762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6500278d-f5a4-46b6-9415-2ae65c7a2762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:40 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a868a6-3535-4039-b19b-79a4c07354d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:40 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Volume b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb', 'volume_size': 1} Nov 05 04:03:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:40 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e13e7f-51ea-499e-8739-c811fabac4f4]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-afef6156-3526-40dd-9d1f-cc29503e2a07 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:40 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0 Nov 05 04:03:40 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:40 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-afef6156-3526-40dd-9d1f-cc29503e2a07 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0" returned: 0 in 0.355s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-afef6156-3526-40dd-9d1f-cc29503e2a07 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.c777cd79-234c-458f-b202-935eb0bd37f9 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:40 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.c777cd79-234c-458f-b202-935eb0bd37f9 1G Nov 05 04:03:40 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:40 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-afef6156-3526-40dd-9d1f-cc29503e2a07 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.c777cd79-234c-458f-b202-935eb0bd37f9 1G" returned: 0 in 0.384s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:40 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-afef6156-3526-40dd-9d1f-cc29503e2a07 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.c777cd79-234c-458f-b202-935eb0bd37f9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:40 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.c777cd79-234c-458f-b202-935eb0bd37f9 Nov 05 04:03:40 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:41 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-afef6156-3526-40dd-9d1f-cc29503e2a07 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.c777cd79-234c-458f-b202-935eb0bd37f9" returned: 0 in 0.282s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:41 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-afef6156-3526-40dd-9d1f-cc29503e2a07 tempest-ProjectMemberTests-1074212560 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.c777cd79-234c-458f-b202-935eb0bd37f9 is being set with open permissions: ugo+rw Nov 05 04:03:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-afef6156-3526-40dd-9d1f-cc29503e2a07 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.c777cd79-234c-458f-b202-935eb0bd37f9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:41 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.c777cd79-234c-458f-b202-935eb0bd37f9 Nov 05 04:03:41 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:41 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-afef6156-3526-40dd-9d1f-cc29503e2a07 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.c777cd79-234c-458f-b202-935eb0bd37f9" returned: 0 in 0.244s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-afef6156-3526-40dd-9d1f-cc29503e2a07 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:41 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.info Nov 05 04:03:41 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:41 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-afef6156-3526-40dd-9d1f-cc29503e2a07 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.info" returned: 0 in 0.245s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:41 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-afef6156-3526-40dd-9d1f-cc29503e2a07 tempest-ProjectMemberTests-1074212560 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.info is being set with open permissions: ugo+rw Nov 05 04:03:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-afef6156-3526-40dd-9d1f-cc29503e2a07 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:41 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.info Nov 05 04:03:41 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:41 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-afef6156-3526-40dd-9d1f-cc29503e2a07 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.info" returned: 0 in 0.255s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-afef6156-3526-40dd-9d1f-cc29503e2a07 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.929s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.821s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:41 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115749942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc5fbd635b4402b9fcf8c66764d2691',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:40Z,use_quota=True,user_id='d4a9fadb31bd47b3acb36428d8197afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:03:41 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Creating volume b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:03:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:41 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:41 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:41 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:03:41 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:03:41 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:41 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb 1073741824 Nov 05 04:03:41 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:41 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-afef6156-3526-40dd-9d1f-cc29503e2a07 tempest-ProjectMemberTests-1074212560 None] Create snapshot completed successfully Nov 05 04:03:42 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb 1073741824" returned: 0 in 0.403s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:42 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb Nov 05 04:03:42 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:42 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb" returned: 0 in 0.237s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:42 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:03:42 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37a868a6-3535-4039-b19b-79a4c07354d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2f6cc3-bd30-48f3-aad1-c591b309b408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:42 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Volume volume-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb (b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb): created successfully Nov 05 04:03:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a2f6cc3-bd30-48f3-aad1-c591b309b408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:42 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Flow 'volume_create_manager' (d242ca66-4784-4836-b374-8bd94de9fc2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:42 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-eac36cf6-6665-43dd-857b-e4c0a87147cf tempest-ProjectReaderTests-1976089566 None] Created volume successfully. Nov 05 04:03:42 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-c777cd79-234c-458f-b202-935eb0bd37f9-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-c777cd79-234c-458f-b202-935eb0bd37f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-c777cd79-234c-458f-b202-935eb0bd37f9" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-c777cd79-234c-458f-b202-935eb0bd37f9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] Deleting offline snapshot c777cd79-234c-458f-b202-935eb0bd37f9 of volume b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] snapshot_file for this snap is: volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.c777cd79-234c-458f-b202-935eb0bd37f9 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-de1451e6-c846-4ea4-9bc1-a54887a84458 tempest-ProjectReaderTests-1976089566 None] Acquiring lock "cinder-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d85774-71f6-4865-8902-2a60f3761b8f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.c777cd79-234c-458f-b202-935eb0bd37f9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-de1451e6-c846-4ea4-9bc1-a54887a84458 tempest-ProjectReaderTests-1976089566 None] Lock "cinder-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-de1451e6-c846-4ea4-9bc1-a54887a84458 tempest-ProjectReaderTests-1976089566 None] Acquiring lock "cinder-quobyte-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-de1451e6-c846-4ea4-9bc1-a54887a84458 tempest-ProjectReaderTests-1976089566 None] Lock "cinder-quobyte-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb" acquired by "delete_volume" :: waited 0.014s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9207028-d106-4b44-be98-39ab51634754]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-de1451e6-c846-4ea4-9bc1-a54887a84458 tempest-ProjectReaderTests-1976089566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:43 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.c777cd79-234c-458f-b202-935eb0bd37f9 Nov 05 04:03:43 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:43 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb Nov 05 04:03:43 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:43 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.c777cd79-234c-458f-b202-935eb0bd37f9" returned: 0 in 0.379s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee88245-b6d5-4a4a-bb4d-a2a6b0f3fcb8]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:43 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-de1451e6-c846-4ea4-9bc1-a54887a84458 tempest-ProjectReaderTests-1976089566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb" returned: 0 in 0.378s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-de1451e6-c846-4ea4-9bc1-a54887a84458 tempest-ProjectReaderTests-1976089566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:43 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0 Nov 05 04:03:43 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:43 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb Nov 05 04:03:43 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:43 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-de1451e6-c846-4ea4-9bc1-a54887a84458 tempest-ProjectReaderTests-1976089566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb" returned: 0 in 0.253s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-de1451e6-c846-4ea4-9bc1-a54887a84458 tempest-ProjectReaderTests-1976089566 None] Lock "cinder-quobyte-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb" released by "delete_volume" :: held 0.676s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:43 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0" returned: 0 in 0.371s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.c777cd79-234c-458f-b202-935eb0bd37f9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:43 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.c777cd79-234c-458f-b202-935eb0bd37f9 Nov 05 04:03:43 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:43 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-de1451e6-c846-4ea4-9bc1-a54887a84458 tempest-ProjectReaderTests-1976089566 None] Created reservations ['1397816d-0c2d-4745-a078-662983fb4f4e', '47a80186-4442-442e-857a-ab39e0c33366', '57a4baa6-4f2a-44b9-baaa-dcc6b9e5f4b9', '1a5ad79f-24d3-4bc5-82de-9c3b3b732ec8'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-de1451e6-c846-4ea4-9bc1-a54887a84458 tempest-ProjectReaderTests-1976089566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-de1451e6-c846-4ea4-9bc1-a54887a84458 tempest-ProjectReaderTests-1976089566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-de1451e6-c846-4ea4-9bc1-a54887a84458 tempest-ProjectReaderTests-1976089566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:44 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-de1451e6-c846-4ea4-9bc1-a54887a84458 tempest-ProjectReaderTests-1976089566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-de1451e6-c846-4ea4-9bc1-a54887a84458 tempest-ProjectReaderTests-1976089566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-de1451e6-c846-4ea4-9bc1-a54887a84458 tempest-ProjectReaderTests-1976089566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:44 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:03:44 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:44 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.c777cd79-234c-458f-b202-935eb0bd37f9" returned: 0 in 0.359s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.c777cd79-234c-458f-b202-935eb0bd37f9 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:44 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.c777cd79-234c-458f-b202-935eb0bd37f9 Nov 05 04:03:44 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:44 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-de1451e6-c846-4ea4-9bc1-a54887a84458 tempest-ProjectReaderTests-1976089566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.264s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:44 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-de1451e6-c846-4ea4-9bc1-a54887a84458 tempest-ProjectReaderTests-1976089566 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:03:44 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-de1451e6-c846-4ea4-9bc1-a54887a84458 tempest-ProjectReaderTests-1976089566 None] Deleted volume successfully. Nov 05 04:03:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-de1451e6-c846-4ea4-9bc1-a54887a84458 tempest-ProjectReaderTests-1976089566 None] Lock "cinder-b22ad7c7-f1c8-43db-af4c-02e6d0ec63bb-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:44 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:44 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0.c777cd79-234c-458f-b202-935eb0bd37f9" returned: 0 in 0.276s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-c777cd79-234c-458f-b202-935eb0bd37f9" released by "_delete_snapshot" :: held 1.520s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0" released by "delete_snapshot" :: held 1.546s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:44 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=203,cinder:UPDATE=225,cinder:INSERT=71,cinder:DELETE=22 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:03:44 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=190,cinder:INSERT=55,cinder:UPDATE=249,cinder:DELETE=19 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:03:44 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] Created reservations ['314996d2-643b-47e1-b084-dc1ae132b8c7', '501f0e66-2f25-459c-8e61-09c27502236f', '409ecae8-6068-4d7c-acba-9b226f9bb50d', 'edddee09-2735-4e58-82f9-f467788f3bfc'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:44 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] Delete snapshot completed successfully. Nov 05 04:03:44 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-081b0796-d828-44e2-b98f-3abe86cf4aa3 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-c777cd79-234c-458f-b202-935eb0bd37f9-delete_snapshot" released by "delete_snapshot" :: held 1.709s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f773bd24-675b-469e-8297-53b0c0c90c68 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f773bd24-675b-469e-8297-53b0c0c90c68 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f773bd24-675b-469e-8297-53b0c0c90c68 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f773bd24-675b-469e-8297-53b0c0c90c68 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0" acquired by "delete_volume" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:45 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a1d384-de34-4b56-b29b-62fea58b1ec6]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f773bd24-675b-469e-8297-53b0c0c90c68 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:45 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0 Nov 05 04:03:45 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:45 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f773bd24-675b-469e-8297-53b0c0c90c68 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0" returned: 0 in 0.381s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f773bd24-675b-469e-8297-53b0c0c90c68 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:45 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0 Nov 05 04:03:45 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:45 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:45 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f773bd24-675b-469e-8297-53b0c0c90c68 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0" returned: 0 in 0.253s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:45 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f773bd24-675b-469e-8297-53b0c0c90c68 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0" released by "delete_volume" :: held 0.703s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-f773bd24-675b-469e-8297-53b0c0c90c68 tempest-ProjectMemberTests-1074212560 None] Created reservations ['5f0942de-3774-47dc-b4b6-f66c829e7cca', 'bd2d68b8-146f-460e-b17f-e3f3c227e801', '8580b0c1-c600-4716-8f88-5b0c199d057d', 'd7d9d77e-7811-4e46-8020-04bec34cb91b'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f773bd24-675b-469e-8297-53b0c0c90c68 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f773bd24-675b-469e-8297-53b0c0c90c68 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f773bd24-675b-469e-8297-53b0c0c90c68 tempest-ProjectMemberTests-1074212560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-f773bd24-675b-469e-8297-53b0c0c90c68 tempest-ProjectMemberTests-1074212560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-f773bd24-675b-469e-8297-53b0c0c90c68 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f773bd24-675b-469e-8297-53b0c0c90c68 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:46 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:03:46 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:46 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-f773bd24-675b-469e-8297-53b0c0c90c68 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.242s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-f773bd24-675b-469e-8297-53b0c0c90c68 tempest-ProjectMemberTests-1074212560 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:03:46 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-f773bd24-675b-469e-8297-53b0c0c90c68 tempest-ProjectMemberTests-1074212560 None] Deleted volume successfully. Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-f773bd24-675b-469e-8297-53b0c0c90c68 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-b92eeea5-9e4b-4fed-ac27-d32ba4bdc1e0-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Flow 'volume_create_manager' (ba33cfd2-9f79-4585-9f93-51f0b5e318b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70f1dfa-c0ec-4722-8238-f76b47b1a346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70f1dfa-c0ec-4722-8238-f76b47b1a346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-34659233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e7ae4e-8403-478f-aaee-ce47fbe5abe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3010d6d3e434042bd27e53719a4555c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:47Z,use_quota=True,user_id='7b969d6cb8a54a0fb326f742289e9663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c709f2-94de-4fec-bbb6-0bde2fcfed6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c709f2-94de-4fec-bbb6-0bde2fcfed6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c21753c-82f3-4574-ab31-aeac60ef67cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c21753c-82f3-4574-ab31-aeac60ef67cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42e7ae4e-8403-478f-aaee-ce47fbe5abe8', 'volume_name': 'volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (accd3382-02ca-42a9-994b-49d8040e2d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (accd3382-02ca-42a9-994b-49d8040e2d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (888de9da-1a4e-4c7a-bbbd-3c9d570b073c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:46 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Volume 42e7ae4e-8403-478f-aaee-ce47fbe5abe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8', 'volume_size': 1} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-34659233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e7ae4e-8403-478f-aaee-ce47fbe5abe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3010d6d3e434042bd27e53719a4555c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:47Z,use_quota=True,user_id='7b969d6cb8a54a0fb326f742289e9663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Creating volume 42e7ae4e-8403-478f-aaee-ce47fbe5abe8 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:03:46 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:03:46 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:46 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8 1073741824 Nov 05 04:03:46 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:47 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8 1073741824" returned: 0 in 0.394s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:47 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8 Nov 05 04:03:47 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:47 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8" returned: 0 in 0.249s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:03:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (888de9da-1a4e-4c7a-bbbd-3c9d570b073c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16abadd-030e-4a94-a3d7-5167d05c31b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:47 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Volume volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8 (42e7ae4e-8403-478f-aaee-ce47fbe5abe8): created successfully Nov 05 04:03:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16abadd-030e-4a94-a3d7-5167d05c31b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:47 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Flow 'volume_create_manager' (ba33cfd2-9f79-4585-9f93-51f0b5e318b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:47 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-73a49bb3-3387-4b38-bafe-7327636d50e0 tempest-ProjectMemberTests-1074212560 None] Created volume successfully. Nov 05 04:03:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8e37ea61-f4fd-4964-b1e5-0626194bc4ae tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8e37ea61-f4fd-4964-b1e5-0626194bc4ae tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:47 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-8e37ea61-f4fd-4964-b1e5-0626194bc4ae tempest-ProjectMemberTests-1074212560 None] Creating offline snapshot 3207987f-f733-43b1-a715-5f0f63e998b1 of volume 42e7ae4e-8403-478f-aaee-ce47fbe5abe8 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:03:47 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42f1526-6125-4ea6-8ccd-48e952b9e414]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:47 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e37ea61-f4fd-4964-b1e5-0626194bc4ae tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:48 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8 Nov 05 04:03:48 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:48 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e37ea61-f4fd-4964-b1e5-0626194bc4ae tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8" returned: 0 in 0.369s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e37ea61-f4fd-4964-b1e5-0626194bc4ae tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.3207987f-f733-43b1-a715-5f0f63e998b1 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:48 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.3207987f-f733-43b1-a715-5f0f63e998b1 1G Nov 05 04:03:48 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:48 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e37ea61-f4fd-4964-b1e5-0626194bc4ae tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.3207987f-f733-43b1-a715-5f0f63e998b1 1G" returned: 0 in 0.409s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:48 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e37ea61-f4fd-4964-b1e5-0626194bc4ae tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.3207987f-f733-43b1-a715-5f0f63e998b1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:48 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.3207987f-f733-43b1-a715-5f0f63e998b1 Nov 05 04:03:48 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:49 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e37ea61-f4fd-4964-b1e5-0626194bc4ae tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.3207987f-f733-43b1-a715-5f0f63e998b1" returned: 0 in 0.329s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:49 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-8e37ea61-f4fd-4964-b1e5-0626194bc4ae tempest-ProjectMemberTests-1074212560 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.3207987f-f733-43b1-a715-5f0f63e998b1 is being set with open permissions: ugo+rw Nov 05 04:03:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e37ea61-f4fd-4964-b1e5-0626194bc4ae tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.3207987f-f733-43b1-a715-5f0f63e998b1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:49 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.3207987f-f733-43b1-a715-5f0f63e998b1 Nov 05 04:03:49 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:49 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e37ea61-f4fd-4964-b1e5-0626194bc4ae tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.3207987f-f733-43b1-a715-5f0f63e998b1" returned: 0 in 0.294s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e37ea61-f4fd-4964-b1e5-0626194bc4ae tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:49 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.info Nov 05 04:03:49 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:49 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e37ea61-f4fd-4964-b1e5-0626194bc4ae tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.info" returned: 0 in 0.254s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:49 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-8e37ea61-f4fd-4964-b1e5-0626194bc4ae tempest-ProjectMemberTests-1074212560 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.info is being set with open permissions: ugo+rw Nov 05 04:03:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e37ea61-f4fd-4964-b1e5-0626194bc4ae tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:49 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.info Nov 05 04:03:49 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:49 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8e37ea61-f4fd-4964-b1e5-0626194bc4ae tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.info" returned: 0 in 0.250s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:49 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8e37ea61-f4fd-4964-b1e5-0626194bc4ae tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:49 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-8e37ea61-f4fd-4964-b1e5-0626194bc4ae tempest-ProjectMemberTests-1074212560 None] Create snapshot completed successfully Nov 05 04:03:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-3207987f-f733-43b1-a715-5f0f63e998b1-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-3207987f-f733-43b1-a715-5f0f63e998b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-42e7ae4e-8403-478f-aaee-ce47fbe5abe8" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-42e7ae4e-8403-478f-aaee-ce47fbe5abe8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-3207987f-f733-43b1-a715-5f0f63e998b1" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:50 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-3207987f-f733-43b1-a715-5f0f63e998b1" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] Deleting offline snapshot 3207987f-f733-43b1-a715-5f0f63e998b1 of volume 42e7ae4e-8403-478f-aaee-ce47fbe5abe8 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:03:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] snapshot_file for this snap is: volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.3207987f-f733-43b1-a715-5f0f63e998b1 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:03:50 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a6246d-5209-4e3c-9b74-6f704b592ef6]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.3207987f-f733-43b1-a715-5f0f63e998b1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:50 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.3207987f-f733-43b1-a715-5f0f63e998b1 Nov 05 04:03:50 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:50 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.3207987f-f733-43b1-a715-5f0f63e998b1" returned: 0 in 0.351s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:50 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:03:50 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d298ce6-5949-4e63-86a6-e83f86a31839]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:50 devstack sudo[108225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8 Nov 05 04:03:50 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:50 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8" returned: 0 in 0.365s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:50 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.3207987f-f733-43b1-a715-5f0f63e998b1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:50 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.3207987f-f733-43b1-a715-5f0f63e998b1 Nov 05 04:03:50 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:51 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.3207987f-f733-43b1-a715-5f0f63e998b1" returned: 0 in 0.324s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.3207987f-f733-43b1-a715-5f0f63e998b1 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:51 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.3207987f-f733-43b1-a715-5f0f63e998b1 Nov 05 04:03:51 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:51 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:51 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8.3207987f-f733-43b1-a715-5f0f63e998b1" returned: 0 in 0.256s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:51 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-3207987f-f733-43b1-a715-5f0f63e998b1" released by "_delete_snapshot" :: held 1.389s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:51 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-42e7ae4e-8403-478f-aaee-ce47fbe5abe8" released by "delete_snapshot" :: held 1.408s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:51 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] Created reservations ['c7659ec8-6484-49fc-9774-c85a19603caa', '783596a6-41fa-4cb5-994d-96b467acf7ce', '8c31030f-bd4f-4f1a-9478-531a12c145a3', 'a7cfe70b-0f92-471d-83eb-3f9253fea15a'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:51 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] Delete snapshot completed successfully. Nov 05 04:03:51 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-db600c3d-7673-4e00-aa3d-07a8a1c9e461 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-3207987f-f733-43b1-a715-5f0f63e998b1-delete_snapshot" released by "delete_snapshot" :: held 1.539s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fbc2d2b2-715d-4c64-9c74-d90c0c58f097 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-42e7ae4e-8403-478f-aaee-ce47fbe5abe8-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fbc2d2b2-715d-4c64-9c74-d90c0c58f097 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-42e7ae4e-8403-478f-aaee-ce47fbe5abe8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fbc2d2b2-715d-4c64-9c74-d90c0c58f097 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-42e7ae4e-8403-478f-aaee-ce47fbe5abe8" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fbc2d2b2-715d-4c64-9c74-d90c0c58f097 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-42e7ae4e-8403-478f-aaee-ce47fbe5abe8" acquired by "delete_volume" :: waited 0.015s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:52 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[7055d37c-695f-488e-91d7-82cd6f485c38]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fbc2d2b2-715d-4c64-9c74-d90c0c58f097 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:52 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8 Nov 05 04:03:52 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:52 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fbc2d2b2-715d-4c64-9c74-d90c0c58f097 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8" returned: 0 in 0.353s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fbc2d2b2-715d-4c64-9c74-d90c0c58f097 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:52 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8 Nov 05 04:03:52 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:52 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:52 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fbc2d2b2-715d-4c64-9c74-d90c0c58f097 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-42e7ae4e-8403-478f-aaee-ce47fbe5abe8" returned: 0 in 0.239s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:52 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fbc2d2b2-715d-4c64-9c74-d90c0c58f097 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-42e7ae4e-8403-478f-aaee-ce47fbe5abe8" released by "delete_volume" :: held 0.652s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-fbc2d2b2-715d-4c64-9c74-d90c0c58f097 tempest-ProjectMemberTests-1074212560 None] Created reservations ['c7f319f7-f271-494f-8d16-69581e5c1416', 'fd3a25da-eda9-487b-a11c-128f5e4724d8', '461c6243-203f-4d74-a731-8ba8e25f0097', 'c1b36b73-952d-4c07-b1d3-f772aafc1399'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-fbc2d2b2-715d-4c64-9c74-d90c0c58f097 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-fbc2d2b2-715d-4c64-9c74-d90c0c58f097 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-fbc2d2b2-715d-4c64-9c74-d90c0c58f097 tempest-ProjectMemberTests-1074212560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-fbc2d2b2-715d-4c64-9c74-d90c0c58f097 tempest-ProjectMemberTests-1074212560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-fbc2d2b2-715d-4c64-9c74-d90c0c58f097 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fbc2d2b2-715d-4c64-9c74-d90c0c58f097 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:53 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:03:53 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:53 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fbc2d2b2-715d-4c64-9c74-d90c0c58f097 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.273s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-fbc2d2b2-715d-4c64-9c74-d90c0c58f097 tempest-ProjectMemberTests-1074212560 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:03:53 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-fbc2d2b2-715d-4c64-9c74-d90c0c58f097 tempest-ProjectMemberTests-1074212560 None] Deleted volume successfully. Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fbc2d2b2-715d-4c64-9c74-d90c0c58f097 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-42e7ae4e-8403-478f-aaee-ce47fbe5abe8-delete_volume" released by "delete_volume" :: held 1.126s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Flow 'volume_create_manager' (4eca3aa6-4a3b-4c02-99a3-2cba453b7f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e987162f-c0b6-4dfe-aa69-c5750bf624d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e987162f-c0b6-4dfe-aa69-c5750bf624d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-908432478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3bbdd94-6316-42b8-8e74-0a01517d3876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3010d6d3e434042bd27e53719a4555c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:54Z,use_quota=True,user_id='7b969d6cb8a54a0fb326f742289e9663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2abf48c4-f059-4956-bb98-e725dafe8885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2abf48c4-f059-4956-bb98-e725dafe8885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f617bf-c31f-4a56-be1e-9c63bbc139e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f617bf-c31f-4a56-be1e-9c63bbc139e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3bbdd94-6316-42b8-8e74-0a01517d3876', 'volume_name': 'volume-a3bbdd94-6316-42b8-8e74-0a01517d3876', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee16933-0738-470b-90d7-9ef3806145e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee16933-0738-470b-90d7-9ef3806145e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311d8081-902b-4820-a06e-0fa4b70f1fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:53 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Volume a3bbdd94-6316-42b8-8e74-0a01517d3876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3bbdd94-6316-42b8-8e74-0a01517d3876', 'volume_size': 1} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-908432478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3bbdd94-6316-42b8-8e74-0a01517d3876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3010d6d3e434042bd27e53719a4555c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:03:54Z,use_quota=True,user_id='7b969d6cb8a54a0fb326f742289e9663',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Creating volume a3bbdd94-6316-42b8-8e74-0a01517d3876 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:03:53 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:03:53 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:53 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876 1073741824 Nov 05 04:03:53 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:54 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876 1073741824" returned: 0 in 0.431s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:54 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876 Nov 05 04:03:54 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:54 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876" returned: 0 in 0.249s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:54 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:03:54 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (311d8081-902b-4820-a06e-0fa4b70f1fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3bbdd94-6316-42b8-8e74-0a01517d3876', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ea4708-5902-4801-9320-9376de5e691a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:03:54 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Volume volume-a3bbdd94-6316-42b8-8e74-0a01517d3876 (a3bbdd94-6316-42b8-8e74-0a01517d3876): created successfully Nov 05 04:03:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ea4708-5902-4801-9320-9376de5e691a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:03:54 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Flow 'volume_create_manager' (4eca3aa6-4a3b-4c02-99a3-2cba453b7f38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:03:54 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-71564ad4-09f9-42ad-8b9c-9ad094fd4f08 tempest-ProjectMemberTests-1074212560 None] Created volume successfully. Nov 05 04:03:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0a035152-3af8-42b2-bcce-570439625b5e tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0a035152-3af8-42b2-bcce-570439625b5e tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:55 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-0a035152-3af8-42b2-bcce-570439625b5e tempest-ProjectMemberTests-1074212560 None] Creating offline snapshot 6482facc-bcdf-4463-81e5-454df479ae1f of volume a3bbdd94-6316-42b8-8e74-0a01517d3876 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:03:55 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1496557-f8df-4e9d-8dbe-396fcc3bab31]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a035152-3af8-42b2-bcce-570439625b5e tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:55 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876 Nov 05 04:03:55 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:55 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a035152-3af8-42b2-bcce-570439625b5e tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876" returned: 0 in 0.360s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a035152-3af8-42b2-bcce-570439625b5e tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.6482facc-bcdf-4463-81e5-454df479ae1f 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:55 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.6482facc-bcdf-4463-81e5-454df479ae1f 1G Nov 05 04:03:55 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:55 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a035152-3af8-42b2-bcce-570439625b5e tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.6482facc-bcdf-4463-81e5-454df479ae1f 1G" returned: 0 in 0.411s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:55 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a035152-3af8-42b2-bcce-570439625b5e tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3bbdd94-6316-42b8-8e74-0a01517d3876 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.6482facc-bcdf-4463-81e5-454df479ae1f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:55 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3bbdd94-6316-42b8-8e74-0a01517d3876 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.6482facc-bcdf-4463-81e5-454df479ae1f Nov 05 04:03:55 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:56 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a035152-3af8-42b2-bcce-570439625b5e tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3bbdd94-6316-42b8-8e74-0a01517d3876 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.6482facc-bcdf-4463-81e5-454df479ae1f" returned: 0 in 0.287s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:56 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-0a035152-3af8-42b2-bcce-570439625b5e tempest-ProjectMemberTests-1074212560 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.6482facc-bcdf-4463-81e5-454df479ae1f is being set with open permissions: ugo+rw Nov 05 04:03:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a035152-3af8-42b2-bcce-570439625b5e tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.6482facc-bcdf-4463-81e5-454df479ae1f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:56 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.6482facc-bcdf-4463-81e5-454df479ae1f Nov 05 04:03:56 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:56 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a035152-3af8-42b2-bcce-570439625b5e tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.6482facc-bcdf-4463-81e5-454df479ae1f" returned: 0 in 0.245s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a035152-3af8-42b2-bcce-570439625b5e tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:56 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.info Nov 05 04:03:56 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:56 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a035152-3af8-42b2-bcce-570439625b5e tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.info" returned: 0 in 0.257s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:56 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-0a035152-3af8-42b2-bcce-570439625b5e tempest-ProjectMemberTests-1074212560 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.info is being set with open permissions: ugo+rw Nov 05 04:03:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a035152-3af8-42b2-bcce-570439625b5e tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:56 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.info Nov 05 04:03:56 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:56 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-0a035152-3af8-42b2-bcce-570439625b5e tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.info" returned: 0 in 0.268s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:56 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-0a035152-3af8-42b2-bcce-570439625b5e tempest-ProjectMemberTests-1074212560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.911s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:56 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-0a035152-3af8-42b2-bcce-570439625b5e tempest-ProjectMemberTests-1074212560 None] Create snapshot completed successfully Nov 05 04:03:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-6482facc-bcdf-4463-81e5-454df479ae1f-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-6482facc-bcdf-4463-81e5-454df479ae1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-a3bbdd94-6316-42b8-8e74-0a01517d3876" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-a3bbdd94-6316-42b8-8e74-0a01517d3876" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-6482facc-bcdf-4463-81e5-454df479ae1f" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:57 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-6482facc-bcdf-4463-81e5-454df479ae1f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] Deleting offline snapshot 6482facc-bcdf-4463-81e5-454df479ae1f of volume a3bbdd94-6316-42b8-8e74-0a01517d3876 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:03:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] snapshot_file for this snap is: volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.6482facc-bcdf-4463-81e5-454df479ae1f {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:03:57 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[36897039-a592-4ec6-8363-e7dbfb87e49f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.6482facc-bcdf-4463-81e5-454df479ae1f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:57 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.6482facc-bcdf-4463-81e5-454df479ae1f Nov 05 04:03:57 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:57 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.6482facc-bcdf-4463-81e5-454df479ae1f" returned: 0 in 0.384s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:57 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3bbdd94-6316-42b8-8e74-0a01517d3876(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:03:57 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[424fc760-122d-40c7-910a-0e10f8a7552b]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:57 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:57 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876 Nov 05 04:03:57 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:58 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876" returned: 0 in 0.416s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.6482facc-bcdf-4463-81e5-454df479ae1f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:58 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.6482facc-bcdf-4463-81e5-454df479ae1f Nov 05 04:03:58 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:03:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:03:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:03:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:03:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:03:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:03:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:58 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:03:58 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:58 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.6482facc-bcdf-4463-81e5-454df479ae1f" returned: 0 in 0.429s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.6482facc-bcdf-4463-81e5-454df479ae1f {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:58 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.6482facc-bcdf-4463-81e5-454df479ae1f Nov 05 04:03:58 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:58 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.327s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:58 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:03:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:03:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 28 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 04:03:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}} Nov 05 04:03:58 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876.6482facc-bcdf-4463-81e5-454df479ae1f" returned: 0 in 0.327s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:58 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-6482facc-bcdf-4463-81e5-454df479ae1f" released by "_delete_snapshot" :: held 1.664s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-a3bbdd94-6316-42b8-8e74-0a01517d3876" released by "delete_snapshot" :: held 1.690s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:59 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] Created reservations ['236c6abb-9703-4c74-8f7d-571d6877eca4', '0a8bf487-7bd2-4176-8e5c-5641a808ff74', '07b79a34-843f-4dc7-bca5-55e7abf701a9', '263e2568-ccdf-44bb-9d6c-aaf42b2ebf05'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:03:59 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] Delete snapshot completed successfully. Nov 05 04:03:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-fe7b191d-4cde-4d7d-8b00-6209deb64f45 tempest-ProjectMemberTests-1074212560 None] Lock "cinder-6482facc-bcdf-4463-81e5-454df479ae1f-delete_snapshot" released by "delete_snapshot" :: held 1.850s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:03:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-dc47d491-b80f-4a26-bd2a-98c5dc5c325f tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-a3bbdd94-6316-42b8-8e74-0a01517d3876-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-dc47d491-b80f-4a26-bd2a-98c5dc5c325f tempest-ProjectMemberTests-1074212560 None] Lock "cinder-a3bbdd94-6316-42b8-8e74-0a01517d3876-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-dc47d491-b80f-4a26-bd2a-98c5dc5c325f tempest-ProjectMemberTests-1074212560 None] Acquiring lock "cinder-quobyte-a3bbdd94-6316-42b8-8e74-0a01517d3876" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:03:59 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-dc47d491-b80f-4a26-bd2a-98c5dc5c325f tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-a3bbdd94-6316-42b8-8e74-0a01517d3876" acquired by "delete_volume" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:03:59 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53c4ba0-2e0a-4312-a3d0-ce05598ba20e]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:03:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dc47d491-b80f-4a26-bd2a-98c5dc5c325f tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:03:59 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876 Nov 05 04:03:59 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:03:59 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Nov 05 04:03:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dc47d491-b80f-4a26-bd2a-98c5dc5c325f tempest-ProjectMemberTests-1074212560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876" returned: 0 in 0.388s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:03:59 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dc47d491-b80f-4a26-bd2a-98c5dc5c325f tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:00 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876 Nov 05 04:04:00 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:00 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dc47d491-b80f-4a26-bd2a-98c5dc5c325f tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-a3bbdd94-6316-42b8-8e74-0a01517d3876" returned: 0 in 0.255s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-dc47d491-b80f-4a26-bd2a-98c5dc5c325f tempest-ProjectMemberTests-1074212560 None] Lock "cinder-quobyte-a3bbdd94-6316-42b8-8e74-0a01517d3876" released by "delete_volume" :: held 0.707s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:04:00 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-dc47d491-b80f-4a26-bd2a-98c5dc5c325f tempest-ProjectMemberTests-1074212560 None] Created reservations ['6fd490f6-016b-4542-94a3-0a194e973ab1', '47710c9d-c827-49ee-b80f-a0520134d49a', '3f494bad-d8a5-444b-bf9f-926af3aef6ce', '0b1e9f4a-4085-4a9b-bc6f-369a2b19adcf'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:04:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-dc47d491-b80f-4a26-bd2a-98c5dc5c325f tempest-ProjectMemberTests-1074212560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:04:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-dc47d491-b80f-4a26-bd2a-98c5dc5c325f tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:04:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-dc47d491-b80f-4a26-bd2a-98c5dc5c325f tempest-ProjectMemberTests-1074212560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:04:00 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-dc47d491-b80f-4a26-bd2a-98c5dc5c325f tempest-ProjectMemberTests-1074212560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:04:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-dc47d491-b80f-4a26-bd2a-98c5dc5c325f tempest-ProjectMemberTests-1074212560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:04:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dc47d491-b80f-4a26-bd2a-98c5dc5c325f tempest-ProjectMemberTests-1074212560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:00 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:04:00 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:00 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:00 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-dc47d491-b80f-4a26-bd2a-98c5dc5c325f tempest-ProjectMemberTests-1074212560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.311s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:00 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-dc47d491-b80f-4a26-bd2a-98c5dc5c325f tempest-ProjectMemberTests-1074212560 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:04:00 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-dc47d491-b80f-4a26-bd2a-98c5dc5c325f tempest-ProjectMemberTests-1074212560 None] Deleted volume successfully. Nov 05 04:04:00 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-dc47d491-b80f-4a26-bd2a-98c5dc5c325f tempest-ProjectMemberTests-1074212560 None] Lock "cinder-a3bbdd94-6316-42b8-8e74-0a01517d3876-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:04:10 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=43,cinder:INSERT=13,cinder:UPDATE=45,cinder:DELETE=4 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:04:10 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:UPDATE=54,cinder:SELECT=33,cinder:INSERT=14,cinder:DELETE=3 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Flow 'volume_create_manager' (9ca88725-f2e3-49ec-9520-ef41873eaa4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5a49fc-0a62-4756-b923-3409c5b0764d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c5a49fc-0a62-4756-b923-3409c5b0764d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1069817059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51996bec-f864-4301-96d0-7f692206eb83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6823b168472744e4a4d81ccb50e9f42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:21Z,use_quota=True,user_id='d1b4a4382aec411c99585767e58cc636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd7e984-ceb4-4a53-a977-f65509921877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd7e984-ceb4-4a53-a977-f65509921877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a178aa-4ebe-4be3-a54c-97670ee1fe7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a178aa-4ebe-4be3-a54c-97670ee1fe7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51996bec-f864-4301-96d0-7f692206eb83', 'volume_name': 'volume-51996bec-f864-4301-96d0-7f692206eb83', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b99791a-9d1c-41cc-8096-b658a0b6ca60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b99791a-9d1c-41cc-8096-b658a0b6ca60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f8db77-7c0a-44b2-ac92-e51c617b1c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:04:21 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Volume 51996bec-f864-4301-96d0-7f692206eb83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51996bec-f864-4301-96d0-7f692206eb83', 'volume_size': 1} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1069817059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51996bec-f864-4301-96d0-7f692206eb83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6823b168472744e4a4d81ccb50e9f42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:21Z,use_quota=True,user_id='d1b4a4382aec411c99585767e58cc636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)}" {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Creating volume 51996bec-f864-4301-96d0-7f692206eb83 {{(pid=87109) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:04:21 devstack cinder-volume[87109]: INFO cinder.volume.drivers.remotefs [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] casted to osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83 1073741824 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:21 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83 1073741824 Nov 05 04:04:21 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:21 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83 1073741824" returned: 0 in 0.402s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:21 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:21 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83 Nov 05 04:04:21 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:22 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83" returned: 0 in 0.235s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'} {{(pid=87109) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Nov 05 04:04:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:04:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f8db77-7c0a-44b2-ac92-e51c617b1c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51996bec-f864-4301-96d0-7f692206eb83', 'volume_size': 1}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:04:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083ec24a-1adf-4306-9594-52ee2f993fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:04:22 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Volume volume-51996bec-f864-4301-96d0-7f692206eb83 (51996bec-f864-4301-96d0-7f692206eb83): created successfully Nov 05 04:04:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083ec24a-1adf-4306-9594-52ee2f993fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:04:22 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Flow 'volume_create_manager' (9ca88725-f2e3-49ec-9520-ef41873eaa4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:04:22 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-a11abd21-dd4c-4eb3-8bfb-c212105b7ce5 tempest-SnapshotDependencyTests-176567273 None] Created volume successfully. Nov 05 04:04:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d517d279-1535-456c-96be-177047c312f6 tempest-SnapshotDependencyTests-176567273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:04:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d517d279-1535-456c-96be-177047c312f6 tempest-SnapshotDependencyTests-176567273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:04:22 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-d517d279-1535-456c-96be-177047c312f6 tempest-SnapshotDependencyTests-176567273 None] Creating offline snapshot 3e140044-688f-4805-b87d-e7635197e2c3 of volume 51996bec-f864-4301-96d0-7f692206eb83 {{(pid=87109) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 04:04:22 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6922fec-4d7e-4260-9280-9623b398c9b9]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:04:22 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d517d279-1535-456c-96be-177047c312f6 tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:22 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83 Nov 05 04:04:22 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:23 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d517d279-1535-456c-96be-177047c312f6 tempest-SnapshotDependencyTests-176567273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83" returned: 0 in 0.352s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d517d279-1535-456c-96be-177047c312f6 tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3 1G {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:23 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3 1G Nov 05 04:04:23 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:23 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d517d279-1535-456c-96be-177047c312f6 tempest-SnapshotDependencyTests-176567273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3 1G" returned: 0 in 0.407s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d517d279-1535-456c-96be-177047c312f6 tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51996bec-f864-4301-96d0-7f692206eb83 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:23 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51996bec-f864-4301-96d0-7f692206eb83 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3 Nov 05 04:04:23 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:23 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d517d279-1535-456c-96be-177047c312f6 tempest-SnapshotDependencyTests-176567273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51996bec-f864-4301-96d0-7f692206eb83 -F qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3" returned: 0 in 0.308s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:23 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-d517d279-1535-456c-96be-177047c312f6 tempest-SnapshotDependencyTests-176567273 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3 is being set with open permissions: ugo+rw Nov 05 04:04:23 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d517d279-1535-456c-96be-177047c312f6 tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:23 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3 Nov 05 04:04:23 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:24 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d517d279-1535-456c-96be-177047c312f6 tempest-SnapshotDependencyTests-176567273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3" returned: 0 in 0.232s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d517d279-1535-456c-96be-177047c312f6 tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:24 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.info Nov 05 04:04:24 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:24 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d517d279-1535-456c-96be-177047c312f6 tempest-SnapshotDependencyTests-176567273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.info" returned: 0 in 0.241s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:24 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-d517d279-1535-456c-96be-177047c312f6 tempest-SnapshotDependencyTests-176567273 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.info is being set with open permissions: ugo+rw Nov 05 04:04:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d517d279-1535-456c-96be-177047c312f6 tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.info {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:24 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.info Nov 05 04:04:24 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:24 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-d517d279-1535-456c-96be-177047c312f6 tempest-SnapshotDependencyTests-176567273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.info" returned: 0 in 0.231s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:24 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-d517d279-1535-456c-96be-177047c312f6 tempest-SnapshotDependencyTests-176567273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.857s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:04:24 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-d517d279-1535-456c-96be-177047c312f6 tempest-SnapshotDependencyTests-176567273 None] Create snapshot completed successfully Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.volume.flows.manager.create_volume [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Flow 'volume_create_manager' (7a6fbfa7-447d-48c2-8723-e45133f815bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0fd999a-1798-40fa-832b-f8d28ed64c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0fd999a-1798-40fa-832b-f8d28ed64c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T03:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=273b4711-43b9-4f69-9297-c162712433b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6823b168472744e4a4d81ccb50e9f42a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3e140044-688f-4805-b87d-e7635197e2c3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:04:25Z,use_quota=True,user_id='d1b4a4382aec411c99585767e58cc636',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81d872d8-6818-423e-ac3c-79f60a92fc92),volume_type_id=81d872d8-6818-423e-ac3c-79f60a92fc92)' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977a3ce4-6fb4-4b8a-91b1-3ce5f644787c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977a3ce4-6fb4-4b8a-91b1-3ce5f644787c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8eeddf4-4903-4150-a69b-b5cae8d8379a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8eeddf4-4903-4150-a69b-b5cae8d8379a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '273b4711-43b9-4f69-9297-c162712433b0', 'volume_name': 'volume-273b4711-43b9-4f69-9297-c162712433b0', 'volume_size': 1, 'snapshot_id': '3e140044-688f-4805-b87d-e7635197e2c3'}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9cb99aa-9d27-4d8a-ad1e-5e84bbcecbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9cb99aa-9d27-4d8a-ad1e-5e84bbcecbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1204dfa-852a-4244-8591-2f5fa5443cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:04:25 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Volume 273b4711-43b9-4f69-9297-c162712433b0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-273b4711-43b9-4f69-9297-c162712433b0', 'volume_size': 1, 'snapshot_id': '3e140044-688f-4805-b87d-e7635197e2c3'} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Acquiring lock "cinder-quobyte-3e140044-688f-4805-b87d-e7635197e2c3-273b4711-43b9-4f69-9297-c162712433b0" by "_create_volume_from_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Lock "cinder-quobyte-3e140044-688f-4805-b87d-e7635197e2c3-273b4711-43b9-4f69-9297-c162712433b0" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Creating volume 273b4711-43b9-4f69-9297-c162712433b0 from snapshot 3e140044-688f-4805-b87d-e7635197e2c3 {{(pid=87109) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Selected osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9 as target Quobyte volume. {{(pid=87109) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Acquiring lock "cinder-quobyte-273b4711-43b9-4f69-9297-c162712433b0" by "_copy_volume_from_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Lock "cinder-quobyte-273b4711-43b9-4f69-9297-c162712433b0" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] snapshot: 3e140044-688f-4805-b87d-e7635197e2c3, volume: 273b4711-43b9-4f69-9297-c162712433b0, {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f1c774-6a3a-4f1a-a2d1-ffd21f5bfd10]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:25 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3 Nov 05 04:04:25 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:25 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3" returned: 0 in 0.361s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51996bec-f864-4301-96d0-7f692206eb83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ee42f6-a423-4835-9067-51a0fbec6703]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:04:25 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:25 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83 Nov 05 04:04:25 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:26 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83" returned: 0 in 0.345s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] will copy from snapshot at /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83 {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Nov 05 04:04:26 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Creating direct copy from snapshot {{(pid=87109) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Nov 05 04:04:26 devstack cinder-volume[87109]: DEBUG cinder.utils [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Path /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-273b4711-43b9-4f69-9297-c162712433b0 not found in is_blk_device check {{(pid=87109) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Nov 05 04:04:26 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-273b4711-43b9-4f69-9297-c162712433b0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:26 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-273b4711-43b9-4f69-9297-c162712433b0 Nov 05 04:04:26 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:31 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-273b4711-43b9-4f69-9297-c162712433b0" returned: 0 in 5.583s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:31 devstack cinder-volume[87109]: DEBUG cinder.image.image_utils [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Image conversion details: src /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-273b4711-43b9-4f69-9297-c162712433b0 {{(pid=87109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Nov 05 04:04:31 devstack cinder-volume[87109]: INFO cinder.image.image_utils [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Converted 1024.00 MB image at 183.39 MB/s Nov 05 04:04:31 devstack cinder-volume[87109]: WARNING cinder.volume.drivers.remotefs [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-273b4711-43b9-4f69-9297-c162712433b0 is being set with open permissions: ugo+rw Nov 05 04:04:31 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-273b4711-43b9-4f69-9297-c162712433b0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:31 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-273b4711-43b9-4f69-9297-c162712433b0 Nov 05 04:04:31 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:32 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-273b4711-43b9-4f69-9297-c162712433b0" returned: 0 in 0.234s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Lock "cinder-quobyte-273b4711-43b9-4f69-9297-c162712433b0" released by "_copy_volume_from_snapshot" :: held 6.596s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:04:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Lock "cinder-quobyte-3e140044-688f-4805-b87d-e7635197e2c3-273b4711-43b9-4f69-9297-c162712433b0" released by "_create_volume_from_snapshot" :: held 6.659s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:04:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.673s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:04:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1204dfa-852a-4244-8591-2f5fa5443cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-273b4711-43b9-4f69-9297-c162712433b0', 'volume_size': 1, 'snapshot_id': '3e140044-688f-4805-b87d-e7635197e2c3'}' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:04:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58603a77-f017-451a-a990-182915b1dd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 04:04:32 devstack cinder-volume[87109]: INFO cinder.volume.flows.manager.create_volume [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Volume volume-273b4711-43b9-4f69-9297-c162712433b0 (273b4711-43b9-4f69-9297-c162712433b0): created successfully Nov 05 04:04:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58603a77-f017-451a-a990-182915b1dd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87109) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 04:04:32 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Flow 'volume_create_manager' (7a6fbfa7-447d-48c2-8723-e45133f815bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87109) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 04:04:32 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-519aba90-a4ec-4ce4-ae22-b7c1a56f88d7 tempest-SnapshotDependencyTests-176567273 None] Created volume successfully. Nov 05 04:04:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] Acquiring lock "cinder-3e140044-688f-4805-b87d-e7635197e2c3-delete_snapshot" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:04:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] Lock "cinder-3e140044-688f-4805-b87d-e7635197e2c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:04:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] Acquiring lock "cinder-quobyte-51996bec-f864-4301-96d0-7f692206eb83" by "delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:04:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] Lock "cinder-quobyte-51996bec-f864-4301-96d0-7f692206eb83" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:04:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] Acquiring lock "cinder-quobyte-3e140044-688f-4805-b87d-e7635197e2c3" by "_delete_snapshot" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:04:32 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] Lock "cinder-quobyte-3e140044-688f-4805-b87d-e7635197e2c3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:04:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] Deleting offline snapshot 3e140044-688f-4805-b87d-e7635197e2c3 of volume 51996bec-f864-4301-96d0-7f692206eb83 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 04:04:32 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] snapshot_file for this snap is: volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3 {{(pid=87109) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 04:04:32 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a320775-f248-4160-ae50-7d55c9390649]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:04:32 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:33 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3 Nov 05 04:04:33 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:33 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3" returned: 0 in 0.336s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:33 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.remotefs [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51996bec-f864-4301-96d0-7f692206eb83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87109) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 04:04:33 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[016d969a-1a69-4aee-a44b-79d614820c3f]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:04:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:33 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83 Nov 05 04:04:33 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:33 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83" returned: 0 in 0.497s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:33 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:33 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3 Nov 05 04:04:33 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:34 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3" returned: 0 in 0.310s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:34 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3 Nov 05 04:04:34 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:34 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:34 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83.3e140044-688f-4805-b87d-e7635197e2c3" returned: 0 in 0.231s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] Lock "cinder-quobyte-3e140044-688f-4805-b87d-e7635197e2c3" released by "_delete_snapshot" :: held 1.467s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:04:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] Lock "cinder-quobyte-51996bec-f864-4301-96d0-7f692206eb83" released by "delete_snapshot" :: held 1.489s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:04:34 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] Created reservations ['41f54565-5e17-4d76-9e51-9e8838bac5b7', 'b5313d35-c1b4-4208-b6b1-8bd73cdf0278', '91c4d108-6d92-4c03-84ee-dcebcda7fb8b', '5a7d9cb9-034f-4e46-aad8-6148b1d24d39'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:04:34 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] Delete snapshot completed successfully. Nov 05 04:04:34 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-babe6ba4-5a23-4e11-a033-82ae9c2108a7 tempest-SnapshotDependencyTests-176567273 None] Lock "cinder-3e140044-688f-4805-b87d-e7635197e2c3-delete_snapshot" released by "delete_snapshot" :: held 1.612s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:04:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8c5ab387-8b34-4c50-8a28-616dc51ca28a tempest-SnapshotDependencyTests-176567273 None] Acquiring lock "cinder-51996bec-f864-4301-96d0-7f692206eb83-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:04:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8c5ab387-8b34-4c50-8a28-616dc51ca28a tempest-SnapshotDependencyTests-176567273 None] Lock "cinder-51996bec-f864-4301-96d0-7f692206eb83-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:04:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8c5ab387-8b34-4c50-8a28-616dc51ca28a tempest-SnapshotDependencyTests-176567273 None] Acquiring lock "cinder-quobyte-51996bec-f864-4301-96d0-7f692206eb83" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:04:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8c5ab387-8b34-4c50-8a28-616dc51ca28a tempest-SnapshotDependencyTests-176567273 None] Lock "cinder-quobyte-51996bec-f864-4301-96d0-7f692206eb83" acquired by "delete_volume" :: waited 0.013s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:04:35 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[23405e78-80b6-4efa-9a34-229d5901ac26]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:04:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8c5ab387-8b34-4c50-8a28-616dc51ca28a tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:35 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83 Nov 05 04:04:35 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:35 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8c5ab387-8b34-4c50-8a28-616dc51ca28a tempest-SnapshotDependencyTests-176567273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83" returned: 0 in 0.347s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8c5ab387-8b34-4c50-8a28-616dc51ca28a tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:35 devstack sudo[108450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83 Nov 05 04:04:35 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:35 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8c5ab387-8b34-4c50-8a28-616dc51ca28a tempest-SnapshotDependencyTests-176567273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-51996bec-f864-4301-96d0-7f692206eb83" returned: 0 in 0.226s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:35 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8c5ab387-8b34-4c50-8a28-616dc51ca28a tempest-SnapshotDependencyTests-176567273 None] Lock "cinder-quobyte-51996bec-f864-4301-96d0-7f692206eb83" released by "delete_volume" :: held 0.631s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:04:35 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-8c5ab387-8b34-4c50-8a28-616dc51ca28a tempest-SnapshotDependencyTests-176567273 None] Created reservations ['4c0fb115-40b1-47f3-9dea-658021cf4d1d', '4f866383-cd48-4ee5-8819-ce79b4d117a1', '0ac5b8d9-3df9-4480-b19b-1d48e5e5ac7c', '98d176ec-4893-404c-a90a-374e726fa657'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:04:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8c5ab387-8b34-4c50-8a28-616dc51ca28a tempest-SnapshotDependencyTests-176567273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:04:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8c5ab387-8b34-4c50-8a28-616dc51ca28a tempest-SnapshotDependencyTests-176567273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:04:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8c5ab387-8b34-4c50-8a28-616dc51ca28a tempest-SnapshotDependencyTests-176567273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:04:35 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-8c5ab387-8b34-4c50-8a28-616dc51ca28a tempest-SnapshotDependencyTests-176567273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:04:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-8c5ab387-8b34-4c50-8a28-616dc51ca28a tempest-SnapshotDependencyTests-176567273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:04:35 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8c5ab387-8b34-4c50-8a28-616dc51ca28a tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:35 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:04:35 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:36 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-8c5ab387-8b34-4c50-8a28-616dc51ca28a tempest-SnapshotDependencyTests-176567273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.258s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:36 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-8c5ab387-8b34-4c50-8a28-616dc51ca28a tempest-SnapshotDependencyTests-176567273 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:04:36 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-8c5ab387-8b34-4c50-8a28-616dc51ca28a tempest-SnapshotDependencyTests-176567273 None] Deleted volume successfully. Nov 05 04:04:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-8c5ab387-8b34-4c50-8a28-616dc51ca28a tempest-SnapshotDependencyTests-176567273 None] Lock "cinder-51996bec-f864-4301-96d0-7f692206eb83-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:04:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-71e702c9-a2a0-4ef7-a172-77e0f55b7b85 tempest-SnapshotDependencyTests-176567273 None] Acquiring lock "cinder-273b4711-43b9-4f69-9297-c162712433b0-delete_volume" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:04:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-71e702c9-a2a0-4ef7-a172-77e0f55b7b85 tempest-SnapshotDependencyTests-176567273 None] Lock "cinder-273b4711-43b9-4f69-9297-c162712433b0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:04:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-71e702c9-a2a0-4ef7-a172-77e0f55b7b85 tempest-SnapshotDependencyTests-176567273 None] Acquiring lock "cinder-quobyte-273b4711-43b9-4f69-9297-c162712433b0" by "delete_volume" {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 04:04:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-71e702c9-a2a0-4ef7-a172-77e0f55b7b85 tempest-SnapshotDependencyTests-176567273 None] Lock "cinder-quobyte-273b4711-43b9-4f69-9297-c162712433b0" acquired by "delete_volume" :: waited 0.013s {{(pid=87109) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 04:04:36 devstack cinder-volume[87109]: DEBUG oslo.privsep.daemon [-] privsep: reply[15224803-8b50-4f5e-92fc-68832f15977d]: (4, 'qcow2') {{(pid=88399) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 04:04:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-71e702c9-a2a0-4ef7-a172-77e0f55b7b85 tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-273b4711-43b9-4f69-9297-c162712433b0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:36 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-273b4711-43b9-4f69-9297-c162712433b0 Nov 05 04:04:36 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:36 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-71e702c9-a2a0-4ef7-a172-77e0f55b7b85 tempest-SnapshotDependencyTests-176567273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-273b4711-43b9-4f69-9297-c162712433b0" returned: 0 in 0.352s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-71e702c9-a2a0-4ef7-a172-77e0f55b7b85 tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-273b4711-43b9-4f69-9297-c162712433b0 {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:36 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-273b4711-43b9-4f69-9297-c162712433b0 Nov 05 04:04:36 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:36 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:36 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-71e702c9-a2a0-4ef7-a172-77e0f55b7b85 tempest-SnapshotDependencyTests-176567273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea/volume-273b4711-43b9-4f69-9297-c162712433b0" returned: 0 in 0.234s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:36 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-71e702c9-a2a0-4ef7-a172-77e0f55b7b85 tempest-SnapshotDependencyTests-176567273 None] Lock "cinder-quobyte-273b4711-43b9-4f69-9297-c162712433b0" released by "delete_volume" :: held 0.622s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:04:36 devstack cinder-volume[87109]: DEBUG cinder.quota [None req-71e702c9-a2a0-4ef7-a172-77e0f55b7b85 tempest-SnapshotDependencyTests-176567273 None] Created reservations ['0ace0d47-cb6a-4a78-9551-a82895ab4401', '1d27d1c2-7b62-45be-b1a9-58ad7c3a3af3', '1801e522-1538-47ce-9e4a-c4d8d9af9f16', '2052a017-63e8-4ce6-9d3c-f5446eda3c7c'] {{(pid=87109) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 04:04:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-71e702c9-a2a0-4ef7-a172-77e0f55b7b85 tempest-SnapshotDependencyTests-176567273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:04:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-71e702c9-a2a0-4ef7-a172-77e0f55b7b85 tempest-SnapshotDependencyTests-176567273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:04:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-71e702c9-a2a0-4ef7-a172-77e0f55b7b85 tempest-SnapshotDependencyTests-176567273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:04:37 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-71e702c9-a2a0-4ef7-a172-77e0f55b7b85 tempest-SnapshotDependencyTests-176567273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:04:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-71e702c9-a2a0-4ef7-a172-77e0f55b7b85 tempest-SnapshotDependencyTests-176567273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:04:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-71e702c9-a2a0-4ef7-a172-77e0f55b7b85 tempest-SnapshotDependencyTests-176567273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:37 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:04:37 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:37 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:37 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-71e702c9-a2a0-4ef7-a172-77e0f55b7b85 tempest-SnapshotDependencyTests-176567273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.260s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:37 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-71e702c9-a2a0-4ef7-a172-77e0f55b7b85 tempest-SnapshotDependencyTests-176567273 None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:04:37 devstack cinder-volume[87109]: INFO cinder.volume.manager [None req-71e702c9-a2a0-4ef7-a172-77e0f55b7b85 tempest-SnapshotDependencyTests-176567273 None] Deleted volume successfully. Nov 05 04:04:37 devstack cinder-volume[87109]: DEBUG cinder.coordination [None req-71e702c9-a2a0-4ef7-a172-77e0f55b7b85 tempest-SnapshotDependencyTests-176567273 None] Lock "cinder-273b4711-43b9-4f69-9297-c162712433b0-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=87109) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 04:04:47 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:SELECT=29,cinder:INSERT=9,cinder:UPDATE=31,cinder:DELETE=2 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:04:47 devstack cinder-volume[87109]: DEBUG dbcounter [-] [87109] Writing DB stats cinder:UPDATE=28,cinder:SELECT=25,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87109) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 04:04:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:04:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 04:04:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 04:04:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9': None} {{(pid=87109) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Nov 05 04:04:58 devstack cinder-volume[87109]: DEBUG cinder.volume.drivers.quobyte [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3f9b2fe0-af1d-4f1e-a42b-ddf1a5b0e0e9'] {{(pid=87109) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Nov 05 04:04:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.lockutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87109) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 04:04:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 04:04:58 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea Nov 05 04:04:58 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 04:04:58 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Nov 05 04:04:58 devstack cinder-volume[87109]: DEBUG oslo_concurrency.processutils [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/41b346c5efb8d970973d25344a24e0ea" returned: 0 in 0.226s {{(pid=87109) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 04:04:58 devstack cinder-volume[87109]: DEBUG cinder.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Notifying Schedulers of capabilities ... {{(pid=87109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 04:04:58 devstack cinder-volume[87109]: DEBUG oslo_service.periodic_task [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] Running periodic task VolumeManager._thread_info {{(pid=87109) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 04:04:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread count: 28 {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5718}} Nov 05 04:04:58 devstack cinder-volume[87109]: DEBUG cinder.volume.manager [None req-035d67c7-941d-448e-9661-675c10b14e07 None None] thread info: [<_MainThread(MainThread, started 128278279188608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87109) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5719}}